Closed-Loop Evaluation of Bird's-Eye-View Maps from Cross-View Transformers as Inputs to Behavior-Cloning Policies

📅 2026-09-05
📈 Citations: 0
Influential: 0
📄 PDF
📝 Abstract
In autonomous driving, Bird's-Eye View (BEV) representations provide a structured, top-down abstraction of the vehicle's surroundings and have become a key input modality for Behavioral Cloning (BC) policies. While ground-truth BEV maps are readily available in simulation, real-world deployment requires replacing them with camera-predicted counterparts - a substitution that introduces perceptual errors whose downstream impact on closed-loop driving performance is not well understood. In this work, we investigate the use of Cross-View Transformer (CVT)-predicted BEV maps as direct policy inputs for a BC agent in the CARLA simulator. We propose a six-channel BEV representation covering road surface, planned route, lane boundaries, vehicles, pedestrians, and traffic lights, and introduce a Kernel Density Estimation (KDE) weighting scheme that rebalances the segmentation loss towards underrepresented driving maneuvers such as curves and intersections. Closed-loop evaluation across two CARLA towns shows that the KDE-weighted model is the only predicted-BEV agent to complete a full episode without infractions, despite not achieving the highest aggregate IoU. This discrepancy reveals that global segmentation metrics are poor proxies for driving performance: what determines navigation success is prediction quality at geometrically critical locations, and the route channel emerges as the primary bottleneck for reliable agent navigation under predicted BEV inputs.
Problem

Research questions and friction points this paper is trying to address.

Bird's-Eye View
Behavioral Cloning
Cross-View Transformer
perceptual errors
closed-loop driving performance
Innovation

Methods, ideas, or system contributions that make the work stand out.

Cross-View Transformer (CVT)
Bird's-Eye View (BEV) maps
Kernel Density Estimation (KDE)
Behavioral Cloning (BC)
🔎 Similar Papers
No similar papers found.
💼 Related Jobs
No related jobs found.
F
Felipe Carlos dos Santos
Federal University of Santa Catarina (UFSC), Florianópolis, Brazil, Department of Automation and Systems Engineering
E
Eric Antonelo
Federal University of Santa Catarina (UFSC), Florianópolis, Brazil, Department of Automation and Systems Engineering
G
Gustavo Claudio Karl Couto
Federal University of Santa Catarina (UFSC), Florianópolis, Brazil, Department of Automation and Systems Engineering