LetOccVote: Learning Weakly Supervised 3D Occupancy through Consensus

📅 2026-09-04
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
本文提出LetOccVote方法,通过跨帧投票机制改进几何和语义监督,以解决弱监督3D占据预测中伪标签不可靠的问题。
📝 Abstract
Weakly supervised 3D occupancy prediction reduces the reliance on costly 3D annotations by learning from 2D pseudo-labels generated by vision foundation models. However, existing methods typically use these imperfect pseudo-labels directly as supervision, making occupancy learning vulnerable to erroneous geometric and semantic targets. We observe that agreement across repeated observations provides an inexpensive and reliable cue for assessing pseudo-label reliability. Based on this observation, we propose \textbf{LetOccVote}, a weakly supervised Gaussian-based occupancy framework that leverages cross-frame voting to improve both geometric and semantic supervision. For geometry, Depth Vote exploits cross-frame geometric agreement to refine supported pseudo depth and reject contradictory estimates before volumetric lifting and depth supervision. For semantics, Semantic Vote aggregates pseudo-semantic observations in a shared 3D space to identify reliable and contested evidence, strengthening reliable semantic supervision while filtering unreliable pseudo-label segments. The entire framework is trained solely with 2D pseudo-label supervision without requiring 3D occupancy annotations. On Occ3D-nuScenes, LetOccVote achieves 53.27 IoU and 20.39 mIoU, establishing state-of-the-art performance among methods with 2D pseudo-label supervision.
Problem

Research questions and friction points this paper is trying to address.

Weakly Supervised
3D Occupancy Prediction
Pseudo-labels
Geometric and Semantic Targets
Innovation

Methods, ideas, or system contributions that make the work stand out.

cross-frame voting
weakly supervised 3D occupancy
pseudo-labels
geometric and semantic supervision
💼 Related Jobs
No related jobs found.
C
Chi Zhang
CUHKSZ
Q
Qi Song
Tsinghua University
F
Feifei Li
CUHKSZ
J
Jie Li
Shenzhen Polytechnic University
R
Rui Huang
CUHKSZ