LePlanner: An Iterative Amortized Controller For World Models

📅 2026-09-12
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
LePlanner通过冻结的世界模型预测器学习构建和优化潜在动作序列,解决了在紧凑的潜在空间中高效规划的问题,同时减少了计算量和延迟。
📝 Abstract
World models trained with joint-embedding predictive architectures learn compact, structured latent representations from physical interaction, yet planning in these latent spaces typically relies on one of two costly approaches. Search-based planners such as CEM, MPPI, and iCEM optimize action sequences through many predictor rollouts, achieving strong performance at the cost of high per-decision compute and latency. Policy-based methods amortize inference into a single forward pass but can degrade on contact-rich tasks where the demonstration distribution is multimodal. We propose LePlanner, an amortized iterative controller that learns to construct and refine latent action sequences through a frozen world-model predictor. LePlanner is trained with an arrival-and-hold objective that encourages the controller to reach the goal at the earliest feasible horizon and remain there. This addresses horizon-reset procrastination, a failure mode in which repeated receding-horizon replanning continually postpones goal arrival. An additional action-Gaussian loss keeps generated actions near the support of the offline dataset. Across navigation, contact-rich manipulation, and continuous-control environments, LePlanner matches or exceeds search-based planners while requiring an order of magnitude fewer predictor evaluations and 3-49x lower wall-clock time per decision. It achieves success rates of 98% on PushT, 100% on Reacher, 100% on TwoRooms, and 92% on the OGBench Cube task. These results show that much of the structure discovered through online search can be amortized into a lightweight iterative policy, enabling fast, horizon-aware, nonlinear physical control without online optimization.
Problem

Research questions and friction points this paper is trying to address.

world models
latent space planning
search-based planners
policy-based methods
physical control
Innovation

Methods, ideas, or system contributions that make the work stand out.

Iterative Amortized Controller
World Models
Arrival-and-Hold Objective
Horizon-Reset Procrastination
Action-Gaussian Loss
💼 Related Jobs
No related jobs found.
S
Saksham Bansal
Department of Mechanical Engineering, Indian Institute of Technology Roorkee
O
Om Naphade
Department of Physics, Indian Institute of Technology Roorkee
C
Chayan Aggarwal
Department of Mathematics, Indian Institute of Technology Roorkee
V
Vrishin M
Department of Chemical Engineering, Indian Institute of Technology Roorkee