ROS2SmolVLA: Enabling Small Vision-Language-Action Models for Integration into Industrial-Grade Lightweight Robots

📅 2026-08-24
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
为应对工业生产中批次小、产品变化多的挑战,本文通过适配SmolVLA模型并开发ROS2接口,使轻量级机器人能够基于视觉-语言-动作模型生成适应性动作。
📝 Abstract
Industrial demand changes the paradigms of production. Due to smaller batch sizes and more variations in products, companies face a growing challenge to adopt more adaptive production systems. In particular, robot-based automation is usually static and fails to respond to constantly changing processes. Vision-Language-Action (VLA) Models are a promising opportunity to mitigate this challenge by generating robot actions based on the observed system state. However, current research either focuses on large models that cannot be computed on premise, creating compliance and security challenges, or use lab-grade robot hardware that obscures exploitation in real industrial settings. In this work, we adapt Hugging Face's SmolVLA for Universal Robots lightweight robots. Further, we release the open-source repository ROS2SmolVLA that implements an interface for ROS 2 to SmolVLA, and makes it applicable for industrial-grade hardware. By this, we allow a lenient adoption into lab and industrial environments. We validate the functionality of SmolVLA for a Universal Robots UR10e using a pick-and-place task and give implementation guidelines. Our findings support that SmolVLA is a well-suited option for small-sized tasks that need to be computed on premise.
Problem

Research questions and friction points this paper is trying to address.

Vision-Language-Action Models
Industrial Lightweight Robots
Adaptive Production Systems
Innovation

Methods, ideas, or system contributions that make the work stand out.

SmolVLA
ROS 2
industrial-grade lightweight robots
on-premise computation
💼 Related Jobs
No related jobs found.
Nils Mandischer
Nils Mandischer
University of Augsburg, Germany
Human-Robot TeamingRehabilitation RoboticsAutonomous SystemsRescue Robotics
N
Noah Böckmann
University of Augsburg, Chair of Mechatronics, Am Technologiezentrum 8, 86159 Augsburg, Germany
L
Ludwig Holl
University of Augsburg, Chair of Mechatronics, Am Technologiezentrum 8, 86159 Augsburg, Germany
Lars Mikelsons
Lars Mikelsons
University of Augsburg
MechatronicsScientific Machine Learning