Causal-History Test-Time Scaling for Failure Recovery in Autoregressive World-Action Models

๐Ÿ“… 2026-09-15
๐Ÿ“ˆ Citations: 0
โœจ Influential: 0
๐Ÿ“„ PDF
๐Ÿค– AI Summary
ๆœฌๆ–‡ๆๅ‡บไธ€็งๆ— ้œ€่ฎญ็ปƒ็š„ๆ–นๆณ•๏ผŒ้€š่ฟ‡ๅœจๆต‹่ฏ•ๆ—ถๅฏนๅ› ๆžœๅކๅฒ่ฟ›่กŒ่ฐƒๆ•ดๆฅ่งฃๅ†ณ่‡ชๅ›žๅฝ’ไธ–็•Œ-ๅŠจไฝœๆจกๅž‹ไธญ็š„ๆ‰ง่กŒๅคฑ่ดฅ้—ฎ้ข˜ใ€‚
๐Ÿ“ Abstract
World-action models (WAMs) have emerged as a promising paradigm for robot manipulation by jointly modeling future visual dynamics and robot actions. However, existing WAMs are trained predominantly on successful trajectories, making them prone to failure when real-world execution diverges from the learned dynamics. This issue is amplified in autoregressive WAMs, where execution errors become part of the causal history and continue to influence subsequent predictions. To this end, we introduce \method{}, a training-free framework that reformulates failure recovery as \emph{test-time scaling over causal histories}. This formulation decomposes recovery into three coupled decisions: \emph{when} to revise the causal history, \emph{where} to recover a reliable history prefix, and \emph{which} history configuration best supports subsequent execution. Specifically, \method{} realizes these decisions through three stages: 1) \textbf{Progress-Aware Recovery Trigger} detects persistent non-progress and triggers recovery only when the current execution state permits intervention; 2) \textbf{History-Prefix Recovery} identifies the unreliable history suffix, retrieves a historical anchor matching the current physical state, and reconstructs the causal KV state from the retained prefix while conditioning on the latest real observation; and 3) \textbf{Hypothesis Verification} compares the future continuations induced by complete-history, recovered-prefix, and full-reset hypotheses, and commits the best-supported hypothesis. Experiments in both simulated and real-world manipulation settings demonstrate consistent improvements in task success, while ablations confirm the contribution of each recovery stage.
Problem

Research questions and friction points this paper is trying to address.

World-action Models
Failure Recovery
Autoregressive Predictions
Causal History
Innovation

Methods, ideas, or system contributions that make the work stand out.

test-time scaling
causal histories
failure recovery
autoregressive WAMs
progress-aware
๐Ÿ’ผ Related Jobs
No related jobs found.
Lin Li
Lin Li
Zhejiang University
SLAMComputer VisionLocalizationDeep Learning3D Scene Understanding
L
Long Chen
The Hong Kong University of Science and Technology (HKUST), ACCESS โ€“ AI Chip Center for Emerging Smart Systems, and Zhejiang University
Kwunhang Wong
Kwunhang Wong
The University of Hong Kong
Differential PrivacyHardware Security
J
Jiaming Lei
The Hong Kong University of Science and Technology (HKUST), ACCESS โ€“ AI Chip Center for Emerging Smart Systems, and Zhejiang University
Song Jin
Song Jin
University of Wisconsin-Madison
nanomaterialsrenewable energysolid state chemistryspintronicsnanobiotechnology
S
Shucheng Du
The Hong Kong University of Science and Technology (HKUST), ACCESS โ€“ AI Chip Center for Emerging Smart Systems, and Zhejiang University
Chuhan Zhang
Chuhan Zhang
Hong Kong University of Science and Technology
computer vision
S
Songchen Ma
The Hong Kong University of Science and Technology (HKUST), ACCESS โ€“ AI Chip Center for Emerging Smart Systems, and Zhejiang University
W
Weihao Zhang
The Hong Kong University of Science and Technology (HKUST), ACCESS โ€“ AI Chip Center for Emerging Smart Systems, and Zhejiang University
Jun Xiao
Jun Xiao
The Hong Kong Polytechnic University
image/video processingimage/video restorationimage/video enhancementbayesian machine learning
K
Kwang-Ting Cheng
The Hong Kong University of Science and Technology (HKUST), ACCESS โ€“ AI Chip Center for Emerging Smart Systems, and Zhejiang University