FOCA: Future-Oriented Conditioning for Data-Efficient Vision-Language-Action Adaptation

πŸ“… 2026-06-18
πŸ“ˆ Citations: 0
✨ Influential: 0
πŸ“„ PDF
πŸ€– AI Summary
Existing vision-language-action (VLA) models exhibit limited generalization in few-shot imitation learning. This work proposes a future-conditioned framework that enables long-horizon reasoning without pixel-level reconstruction by explicitly predicting task-relevant future interaction embeddings and implicitly aligning goal observations in a latent space. The approach introduces, for the first time, a future-oriented mechanism into few-shot VLA adaptation, allowing joint training using only action-free videos and interpretable as learning a value-like future-conditioned representation. Experiments demonstrate that the method achieves a 95.7% success rate on the LIBERO benchmark with merely 20 demonstrations, yields 7–12% absolute improvements on RoboCasa, and attains up to a 26% absolute gain in real-world robotic tasks, substantially advancing the state of the art in few-shot VLA adaptation.
πŸ“ Abstract
Vision-Language-Action (VLA) models enable general-purpose robotic control via large-scale multimodal pretraining, yet their effectiveness under few-shot imitation learning remains limited. We conduct a systematic stress test of state-of-the-art VLA models and show that performance degrades sharply as demonstrations are reduced, revealing a key weakness of existing adaptation strategies. To address this, we introduce FOCA, a future-oriented conditioning framework for data-efficient VLA adaptation. FOCA combines explicit prediction of task-grounded future interaction embeddings with implicit alignment to future goal observations, enabling long-horizon reasoning in latent space without pixel-level prediction. This formulation naturally supports action-free co-training with synthetic videos from video world models and can be interpreted as learning a future-conditioned value-like representation. Extensive experiments demonstrate FOCA achieves 95.7% success with 20 demonstrations on LIBERO, improves 7-12% on RoboCasa, and delivers up to 26% absolute gains on real robots, establishing a new state of the art in few-shot VLA adaptation.
Problem

Research questions and friction points this paper is trying to address.

Vision-Language-Action
few-shot imitation learning
data-efficient adaptation
robotic control
multimodal pretraining
Innovation

Methods, ideas, or system contributions that make the work stand out.

future-oriented conditioning
vision-language-action adaptation
data-efficient imitation learning
latent-space reasoning
action-free co-training
πŸ”Ž Similar Papers
No similar papers found.
D
Duc Minh Nguyen
1VinRobotics, Vietnam; 2Center for AI Research, VinUniversity, Vietnam
N
Nghiem Tuong Diep
1VinRobotics, Vietnam; 2Center for AI Research, VinUniversity, Vietnam
B
Binh Gia Nguyen
1VinRobotics, Vietnam; 2Center for AI Research, VinUniversity, Vietnam
T
Trong-Bao Ho
1VinRobotics, Vietnam
D
Doanh Le
2Center for AI Research, VinUniversity, Vietnam
T
Tan Q. Nguyen
1VinRobotics, Vietnam
T
Thien-Loc Ha
1VinRobotics, Vietnam
N
Nhiem Tran
1VinRobotics, Vietnam
Bao Thach
Bao Thach
Google
RoboticsRobot LearningSurgical RoboticsArtificial IntelligenceReinforcement Learning
N
Nhat X. Tran
1VinRobotics, Vietnam
T
Tuan A. Tran
4German Research Center for Artificial Intelligence (DFKI); 6University of Oldenburg, Germany
A
Artur Habuda
5Technical University of Denmark, Denmark
P
Philip Lund MΓΈller
5Technical University of Denmark, Denmark
Tran Nguyen Le
Tran Nguyen Le
Assistant Professor in Robotics,Technical University of Denmark
RoboticsRobotic GraspingRobotic ManipulationMulti-Modal PerceptionMachine Learning
Daniel Sonntag
Daniel Sonntag
DFKI and University of Oldenburg
Interactive Machine LearningIntelligent User InterfacesMultimodal Interaction
M
Matthias Niepert
7University of Stuttgart, Germany; 8Max Planck Research School for Intelligent Systems (IMPRS-IS), Germany
K
Khoa D. Doan
2Center for AI Research, VinUniversity, Vietnam
Vu Duong
Vu Duong
Nanyang Technological University, Singapore
Air TransportationAir Traffic ManagementComplex SystemsAI
H
Hung Ngo
1VinRobotics, Vietnam
M
Minh N. Vu
1VinRobotics, Vietnam; 2Center for AI Research, VinUniversity, Vietnam
D
Duy M. H. Nguyen
4German Research Center for Artificial Intelligence (DFKI); 7University of Stuttgart, Germany; 8Max Planck Research School for Intelligent Systems (IMPRS-IS), Germany
An Thai Le
An Thai Le
Assistant Professor of Computer Science/VinUniversity, Head of AI at VinRobotics
RoboticsReinforcement LearningMachine LearningOptimal Transport
Ngo Anh Vien
Ngo Anh Vien
VinRobotics & VinUni, ex-BCAI
machine learningrobotics