Emerging Trends in Pseudo-Label Refinement for Weakly Supervised Semantic Segmentation with Image-Level Supervision

2025-07-29

AI Summary

This paper presents a systematic survey of weakly supervised semantic segmentation (WSSS) under image-level labels, centering on pseudo-label optimization as the core paradigm. We categorize mainstream approaches—including multi-stage generation, self-training, region-proposal enhancement, and consistency regularization—according to the type and granularity of auxiliary supervision. For the first time, we comprehensively integrate recent advances in pseudo-label refinement. A unified technical taxonomy is proposed, exposing shared bottlenecks in cross-domain adaptation: data distribution shift, noise accumulation during iterative labeling, and limited generalization capacity. Our analysis delivers a clear methodological roadmap for WSSS, critically identifies fundamental limitations of state-of-the-art approaches, and outlines concrete future directions toward robust pseudo-label learning—emphasizing noise-resilient refinement, domain-invariant representation learning, and uncertainty-aware label correction.

Technology Category

• Machine Learning: Semi-Supervised Learning
• Computer Vision: Segmentation
• Search and Optimization: Sampling/Simulation-based Search

Application Category

• Semantics and Knowledge: Methods, algorithms and applications for the development of semantic models, knowledge graphs and other forms of structured data models with machine-interpretable semantics
• Systems and Infrastructure for Web, Mobile and WoT: Applied ML and AI for Web-based mobile applications
• Graph Algorithms and Modeling for the Web: Graph neural networks and deep learning approaches for Web-related graphs

Abstract

Unlike fully supervised semantic segmentation, weakly supervised semantic segmentation (WSSS) relies on weaker forms of supervision to perform dense prediction tasks. Among the various types of weak supervision, WSSS with image level annotations is considered both the most challenging and the most practical, attracting significant research attention. Therefore, in this review, we focus on WSSS with image level annotations. Additionally, this review concentrates on mainstream research directions, deliberately omitting less influential branches. Given the rapid development of new methods and the limitations of existing surveys in capturing recent trends, there is a pressing need for an updated and comprehensive review. Our goal is to fill this gap by synthesizing the latest advancements and state-of-the-art techniques in WSSS with image level labels. Basically, we provide a comprehensive review of recent advancements in WSSS with image level labels, categorizing existing methods based on the types and levels of additional supervision involved. We also examine the challenges of applying advanced methods to domain specific datasets in WSSS,a topic that remains underexplored. Finally, we discuss the current challenges, evaluate the limitations of existing approaches, and outline several promising directions for future research. This review is intended for researchers who are already familiar with the fundamental concepts of WSSS and are seeking to deepen their understanding of current advances and methodological innovations.

Problem

• Review weakly supervised semantic segmentation with image-level labels
• Synthesize latest advancements in pseudo-label refinement techniques
• Explore challenges in domain-specific WSSS applications

Innovation

• Reviewing WSSS with image-level annotations
• Categorizing methods by supervision types
• Exploring domain-specific dataset challenges