PanoWorld: Real-World Panoramic Generation
This work addresses the challenge of modeling long-range memory while preserving physical consistency in panoramic world models under large-scale spatial variations and complex lighting conditions. The authors propose a novel approach based on rotation-equivariant representations that simplifies camera trajectories to translational motion under a fixed orientation. By jointly modeling current actions and historical memory through Dense Panoramic Ray Conditioning (DPRC) and a Geometry-aware Memory Augmentation (GMA) mechanism, the method leverages a three-stage progressive training strategy to optimize the entire system. Key contributions include the first incorporation of rotation equivariance into panoramic world modeling to reduce trajectory complexity, the introduction of World360—the first large-scale hybrid real-simulated panoramic dataset—and state-of-the-art performance on this benchmark, demonstrating superior physical consistency and generation quality.