CARLAverse: A Highly Modular, Distributed, and Multimodal Framework for Human-in-the-Loop Simulation

📅 2026-09-10
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
为解决自动驾驶在混合交通场景中与行人等交互测试问题,提出CARLAverse框架,采用分布式物理架构减少网络延迟,提高仿真真实感。
📝 Abstract
The development of autonomous driving demands comprehensive testing in mixed-traffic scenarios involving vulnerable road users (VRUs), where purely artificial agents often fail to capture authentic human social negotiations. While human-in-the-loop (HITL) simulators enable safe investigation of these interactions, existing multi-agent platforms struggle with the network latency and synchronization constraints required for high-fidelity haptic feedback. To resolve this, we present CARLAverse, an open-source, multimodal simulation ecosystem. Extending modular hardware abstraction, CARLAverse integrates driving (DrivoCARLA), cycling (CycloCARLA), and pedestrian (WalkoCARLA) simulators into a shared virtual environment. Its core methodological contribution is a distributed physics architecture: latency-critical ego dynamics and high-frequency force feedback are computed locally on client nodes, while a central CARLA server orchestrates non-player character (NPC) physics and global traffic. By decoupling haptic control loops from network bottlenecks, CARLAverse enables scalable, cross-institutional HITL experiments without compromising physical immersion. Code and documentation: https://git.ieem-ka.de/simulator-environments/carlaverse
Problem

Research questions and friction points this paper is trying to address.

autonomous driving
mixed-traffic scenarios
vulnerable road users
haptic feedback
network latency
Innovation

Methods, ideas, or system contributions that make the work stand out.

Distributed Physics Architecture
Human-in-the-Loop Simulation
Multimodal Framework
Latency-critical Ego Dynamics
Scalable Cross-institutional Experiments
🔎 Similar Papers
No similar papers found.
P
Patrick Rebling
Institute of Energy Efficient Mobility, Karlsruhe University of Applied Sciences
P
Philipp Nenninger
Institute of Energy Efficient Mobility, Karlsruhe University of Applied Sciences
R
Reiner Kriesten
Institute of Energy Efficient Mobility, Karlsruhe University of Applied Sciences