Fix False Transparency by Noise Guided Splatting

2025-10-17

AI Summary

3D Gaussian Splatting (3DGS) reconstructions of opaque objects suffer from spurious transparency artifacts due to the absence of explicit opacity constraints on object surfaces, causing inconsistent background and interior structure visibility across interactive viewpoints—a flaw masked by standard rendering metrics but detrimental to object-centric visualization quality. This work is the first to systematically identify and quantify this artifact. We propose Noise-Guided Splatting (NGS), which injects opaque Gaussian noise within object interiors and jointly optimizes alpha compositing and photometric loss. To rigorously evaluate transparency fidelity, we introduce a transmittance-based metric and an enhanced benchmark dataset. Experiments demonstrate that NGS effectively suppresses spurious transparency while maintaining state-of-the-art rendering accuracy across multiple benchmarks, exhibiting both efficacy and robustness.

Technology Category

• Computer Vision: Interpretability, Explainability, and Transparency
• Search and Optimization: Non-convex Optimization
• Machine Learning: Transparent, Interpretable, Explainable ML

Application Category

• Security and Privacy: Data transparency and provenance
• Responsible Web: Algorithmic accountability and transparency on the web
• Graph Algorithms and Modeling for the Web: Efficient manipulation of static and dynamic Web-related graphs

Abstract

Opaque objects reconstructed by 3DGS often exhibit a falsely transparent surface, leading to inconsistent background and internal patterns under camera motion in interactive viewing. This issue stems from the ill-posed optimization in 3DGS. During training, background and foreground Gaussians are blended via alpha-compositing and optimized solely against the input RGB images using a photometric loss. As this process lacks an explicit constraint on surface opacity, the optimization may incorrectly assign transparency to opaque regions, resulting in view-inconsistent and falsely transparent. This issue is difficult to detect in standard evaluation settings but becomes particularly evident in object-centric reconstructions under interactive viewing. Although other causes of view-inconsistency have been explored recently, false transparency has not been explicitly identified. To the best of our knowledge, we are the first to identify, characterize, and develop solutions for this artifact, an underreported artifact in 3DGS. Our strategy, NGS, encourages surface Gaussians to adopt higher opacity by injecting opaque noise Gaussians in the object volume during training, requiring only minimal modifications to the existing splatting process. To quantitatively evaluate false transparency in static renderings, we propose a transmittance-based metric that measures the severity of this artifact. In addition, we introduce a customized, high-quality object-centric scan dataset exhibiting pronounced transparency issues, and we augment popular existing datasets with complementary infill noise specifically designed to assess the robustness of 3D reconstruction methods to false transparency. Experiments across multiple datasets show that NGS substantially reduces false transparency while maintaining competitive performance on standard rendering metrics, demonstrating its overall effectiveness.

Problem

• 3DGS reconstruction causes falsely transparent opaque surfaces
• Lack of opacity constraints leads to view-inconsistent artifacts
• Existing methods fail to address this specific transparency issue

Innovation

• Noise guided splatting to increase Gaussian opacity
• Inject opaque noise Gaussians during training
• Transmittance metric to quantify false transparency