SparseGS: Real-Time 360{deg} Sparse View Synthesis using Gaussian Splatting
This work addresses the severe degradation in 3D Gaussian Splatting (3DGS) reconstruction quality under sparse training views (only 3–12 images), manifesting as “floating artifacts” and “background collapse” in unseen viewpoints. To tackle this, we propose a depth-prior-guided optimization framework. Our key contributions are: (1) a geometry-aware depth prior derived from monocular depth estimation, enforcing spatial plausibility of Gaussian distributions; (2) an unseen-view regularization module that explicitly enhances generalization under sparse view coverage; and (3) an adaptive joint geometry-density pruning strategy to improve reconstruction compactness and stability. Integrating differentiable Gaussian rendering, depth-guided optimization, and viewpoint-aware regularization, our method achieves state-of-the-art performance on Mip-NeRF360, LLFF, and DTU benchmarks—reaching top-tier forward-facing scene quality using only three input images, with efficient training and real-time inference.