RetimeGS: Continuous-Time Reconstruction of 4D Gaussian Splatting

2026-03-14

AI Summary

Existing 4D Gaussian splatting methods suffer from overfitting to discrete time frames, hindering continuous-time reconstruction and leading to ghosting artifacts and temporal aliasing during interpolation. To address this, we propose RetimeGS, the first approach to explicitly model the temporal evolution of 3D Gaussians. Our method introduces optical flow–guided initialization and a triple-rendering supervision scheme that incorporates multi-view temporal consistency constraints, effectively mitigating temporal aliasing. RetimeGS achieves high-quality, ghosting-free, and temporally coherent continuous dynamic reconstruction, even under challenging conditions such as high-speed motion, non-rigid deformations, and severe occlusions, significantly outperforming current state-of-the-art techniques.

Technology Category

• Computer Vision: 3D Computer Vision
• Planning, Routing, and Scheduling: Optimization of Spatio-temporal Systems
• Knowledge Representation and Reasoning: Geometric, Spatial, and Temporal Reasoning

Application Category

• Graph Algorithms and Modeling for the Web: Efficient manipulation of static and dynamic Web-related graphs
• Search and Retrieval-Augmented AI: Retrieval-Augmented Generation (RAG) and multi-modal RAG
• User Modeling, Personalization and Recommendation: Fairness-aware retrieval and ranking

Abstract

Temporal retiming, the ability to reconstruct and render dynamic scenes at arbitrary timestamps, is crucial for applications such as slow-motion playback, temporal editing, and post-production. However, most existing 4D Gaussian Splatting (4DGS) methods overfit at discrete frame indices but struggle to represent continuous-time frames, leading to ghosting artifacts when interpolating between timestamps. We identify this limitation as a form of temporal aliasing and propose RetimeGS, a simple yet effective 4DGS representation that explicitly defines the temporal behavior of the 3D Gaussian and mitigates temporal aliasing. To achieve smooth and consistent interpolation, we incorporate optical flow-guided initialization and supervision, triple-rendering supervision, and other targeted strategies. Together, these components enable ghost-free, temporally coherent rendering even under large motions. Experiments on datasets featuring fast motion, non-rigid deformation, and severe occlusions demonstrate that RetimeGS achieves superior quality and coherence over state-of-the-art methods.

Problem

• temporal retiming
• 4D Gaussian Splatting
• temporal aliasing
• continuous-time reconstruction
• ghosting artifacts

Innovation

• 4D Gaussian Splatting
• temporal aliasing
• continuous-time reconstruction
• optical flow guidance
• temporal coherence