HERA: Historical Evidence Routing Adapter for Physical Prediction in Latent World Models
This work addresses the challenge of effectively leveraging historical visual evidence under occlusion by introducing HERA, a lightweight adapter that enables non-intrusive injection of historical information into a frozen latent predictor for the first time. HERA employs a Register-Routed Patch Memory (RRPM) architecture, integrating a structured memory bank with a register mechanism to selectively route relevant historical evidence into the predictor’s working space, thereby enabling precise modeling of physical regularities. Evaluated on the IntPhys2 Main benchmark, the approach improves the AvgSurprise accuracy of V-JEPA 2-G from 52.57% to 54.35%, achieving 57.69% on the fixed-camera continuity subtask and 63.46% on the invariance subtask.