PolypVision: A Three-Stage Hierarchical Deep Learning Framework for Classification and Segmentation of Colorectal Polyps
This study addresses the challenge of accurate detection, segmentation, and endoscopy–histology joint classification of colorectal polyps by proposing a three-stage hierarchical deep learning framework. The first stage employs EfficientNetV2-M for polyp type and morphology classification; the second stage utilizes UNet++ for high-precision segmentation and recommends resection strategies; and the final stage refines adenoma subtyping through transfer learning. Innovatively integrating a task-progressive architecture, task-specific loss functions (Focal Loss and Dice+BCE), and cross-stage knowledge transfer, the framework achieves device-agnostic fully automated analysis. Evaluated on PolypGen, Kvasir-SEG, and CVC-ClinicDB datasets, it attains an AUC of 0.99 and mAP@50 of 94.4%, matching or surpassing current state-of-the-art methods, and has been deployed as a publicly accessible web application.