NormLift: From Lifted Features To Semantic Reliability In 3D Gaussian Splatting

2026-09-16

AI Summary

本文针对3D高斯点云语义可靠性问题，通过在CLIP单位球上重新定义特征提升为余弦对齐问题，并提出NormLift方法，利用特征幅度作为语义可靠性信号进行模式投票优化。

Abstract

Training-free weighted aggregation is widely used to lift 2D semantic features onto 3D Gaussians for open-vocabulary scene understanding, yet its theoretical role remains insufficiently understood. Existing analyses typically justify this operation from the rendering side, treating Gaussian features as linearly composable Euclidean variables for reconstructing 2D feature maps. However, this view does not match downstream 3D usage, where each Gaussian is often queried independently in a cosine-based embedding space. We revisit feature lifting from the 3D side and formulate per-Gaussian assignment as a cosine alignment problem on the CLIP unit sphere. Under this objective, the L2-normalized semantic back-projected feature emerges as the closed-form solution, providing a complementary interpretation of the standard lifting rule from the perspective of per-Gaussian semantic assignment. The same formulation further yields a norm decomposition into intra-view and inter-view consistency, suggesting that feature magnitude itself can serve as a semantic reliability signal. Calibrated by effective multi-view support, this reliability score guides a mode-voting refinement that preserves CLIP feature validity by avoiding linear averaging. Experiments on open-vocabulary 3D semantic segmentation show that NormLift is an efficient, training-free framework that achieves strong performance across evaluation protocols.

Problem

• Feature Lifting
• 3D Gaussian Splatting
• Semantic Reliability
• CLIP Unit Sphere
• Cosine Alignment

Innovation

• NormLift
• cosine alignment
• semantic reliability
• feature lifting
• mode-voting refinement