Research Challenges and Progress in the End-to-End V2X Cooperative Autonomous Driving Competition

2025-07-29

AI Summary

To address practical challenges in vehicle-to-everything (V2X) autonomous driving—including limited communication bandwidth, difficulty in dynamic environment perception, and weak fusion of heterogeneous multi-source data—this paper proposes a bandwidth-aware multimodal sensor fusion mechanism and a robust multi-agent collaborative planning framework. Built upon the UniV2X unified architecture and our newly curated V2X-Seq-SPD sequential dataset, the approach establishes a dual-track paradigm integrating cooperative temporal perception and end-to-end planning, incorporating distributed communication optimization and joint modeling of heterogeneous sensors. We introduce the first standardized V2X evaluation benchmark, attracting over 30 international teams. Experiments demonstrate a 12.7% improvement in collaborative perception accuracy and a 21.3% gain in planning stability. These advances significantly propel V2X systems from isolated perception toward scalable, verifiable cooperative driving paradigms.

Technology Category

• Intelligent Robots: Multimodal Perception & Sensor Fusion
• Computer Vision: Multi-modal Vision
• Planning, Routing, and Scheduling: Planning with Language Models

Application Category

• Systems and Infrastructure for Web, Mobile and WoT: Web performance, measurement, and characterization
• Semantics and Knowledge: Methods to enhance, augment, integrate or synergize semantic models such as knowledge graphs and LLMs
• Search and Retrieval-Augmented AI: Retrieval-Augmented Generation (RAG) and multi-modal RAG

Abstract

With the rapid advancement of autonomous driving technology, vehicle-to-everything (V2X) communication has emerged as a key enabler for extending perception range and enhancing driving safety by providing visibility beyond the line of sight. However, integrating multi-source sensor data from both ego-vehicles and infrastructure under real-world constraints, such as limited communication bandwidth and dynamic environments, presents significant technical challenges. To facilitate research in this area, we organized the End-to-End Autonomous Driving through V2X Cooperation Challenge, which features two tracks: cooperative temporal perception and cooperative end-to-end planning. Built on the UniV2X framework and the V2X-Seq-SPD dataset, the challenge attracted participation from over 30 teams worldwide and established a unified benchmark for evaluating cooperative driving systems. This paper describes the design and outcomes of the challenge, highlights key research problems including bandwidth-aware fusion, robust multi-agent planning, and heterogeneous sensor integration, and analyzes emerging technical trends among top-performing solutions. By addressing practical constraints in communication and data fusion, the challenge contributes to the development of scalable and reliable V2X-cooperative autonomous driving systems.

Problem

• Integrating multi-source sensor data under real-world constraints
• Addressing bandwidth-aware fusion in V2X communication
• Enhancing robust multi-agent planning for autonomous driving

Innovation

• Bandwidth-aware fusion for V2X communication
• Robust multi-agent planning in dynamic environments
• Heterogeneous sensor integration from multiple sources