Continual Field-Adaptive Models (CFAMs) for Post-Deployment Physical AI

📅 2026-09-03
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
研究提出Continual Field-Adaptive Models (CFAMs),通过自主、无梯度的设备更新解决无人操作中数据稀缺和计算资源有限的问题,实现高效的技能学习与保持。
📝 Abstract
Unattended interactive autonomy - machines that step into danger in place of humans and complete tasks with human tools - remains a missing capability in mission-critical operations. These domains offer scarce training data and only onboard compute, yet deployed systems must face novelty without erasing prior competence. We introduce Continual Field-Adaptive Models (CFAMs), which learn efficiently in the lab and continue learning after deployment through autonomous, gradient-free, on-device updates. CFAM uses a complementary learning architecture with a frozen slow-learning component and a fast-learning Capsule Field. The slow component contains three cortices: Sensor, which maps multimodal input into 3D-grounded geometry; Reasoning, which decomposes tasks into skills and evaluates outcomes; and Action, which executes geometric skills. The Capsule Field stores field learning one-shot and gradient-free as Competence Capsules. Skill installation is few-shot in the lab and continual in the field; open-world novelty is outside scope. We evaluate CFAM across five embodiments: manipulator, quadruped, humanoid, quadrotor, and off-road vehicle. Baselines (pi0, CogACT, SpatialVLA) use the same in-house multi-embodiment dataset for physical-platform comparisons. CFAM reaches the operating point of a standard policy trained on the full prior-training dataset using 40% of the data, or 2.5x fewer trajectories. At test time, autonomous capture of verified near-OOD cases improves action success by 13.9 percentage points. In sequential simulation, backward transfer is -0.5 percentage points versus -11.4 for LoRA. CFAM therefore provides a bounded form of post-deployment physical intelligence: few-shot skill learning, autonomous field growth from verified near-OOD experience, and retention of prior competence.
Problem

Research questions and friction points this paper is trying to address.

Unattended interactive autonomy
mission-critical operations
scarce training data
onboard compute
novelty
Innovation

Methods, ideas, or system contributions that make the work stand out.

Continual Field-Adaptive Models
Capsule Field
gradient-free learning
few-shot skill learning
autonomous field growth
💼 Related Jobs
No related jobs found.
A
Amarjot Singh
Skylark Labs
T
Tanmay R. Pancholi
Skylark Labs
J
Jainam Kothari
Skylark Labs
S
Shrirang Mahajan
Skylark Labs
K
Ketan Bansal
Skylark Labs
Zackory Erickson
Zackory Erickson
Assistant Professor, Carnegie Mellon University
RoboticsMachine LearningHuman-Robot InteractionAssistive RoboticsSimulation
Giuseppe Loianno
Giuseppe Loianno
UC Berkeley
RoboticsMAVsVisionSensor Fusion
A
Alexandre M. Bayen
University of California, Berkeley
Jeff Schneider
Jeff Schneider
Carnegie Mellon University
Machine Learning
V
Vince Nakayama
Skylark Labs