MC-DeTra: Motion-Consistent Joint Object Detection and Socially-Aware Trajectory Forecasting in Bird's-Eye-View Images

📅 2026-09-10
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
本文通过添加基于运动一致性的监督机制,改进了在鸟瞰图中联合物体检测和轨迹预测的准确性,特别是在动态和社会化情境下的预测。
📝 Abstract
Unified models for object detection and trajectory forecasting aim to merge perception and prediction for autonomous driving, refining actor trajectories directly over shared bird's-eye-view (BEV) images rasterized from LiDAR and high-definition maps. Their accuracy on dynamic, moving actors, however, remains the hardest part of the task, and the strongest such model, DeTra, has no public implementation. We contribute an openly released DeTra reimplementation with documented approximations, and on top of it MC-DeTra: a family of motion-consistency mechanisms that add supervision through two annotation-derived auxiliary signals -- each actor's observed past motion and the occupancy of the surrounding traffic that forms its social context -- and one inter-output consistency constraint that aligns an actor's predicted heading with its predicted direction of motion. Every proposed loss is train-only and inference-safe: it shapes the shared BEV representation during training and is removed at test time, adding no inference latency. On the Waymo Open Dataset, evaluated under a strict, detection-conditioned forecasting protocol, MC-DeTra improves dynamic, socially-situated trajectory forecasting while preserving or improving detection accuracy; a gradient-based loss-calibration analysis exposes how the auxiliary objectives compete at the shared backbone, and our ablation identifies which signals contribute most. We release code, configurations, and evaluation tooling at https://github.com/diuzhevVlad/MC-DeTra.
Problem

Research questions and friction points this paper is trying to address.

object detection
trajectory forecasting
bird's-eye-view images
dynamic actors
autonomous driving
Innovation

Methods, ideas, or system contributions that make the work stand out.

motion-consistent
socially-aware
trajectory forecasting
bird's-eye-view images
inference-safe
🔎 Similar Papers
No similar papers found.
💼 Related Jobs
No related jobs found.
V
Vladislav Diuzhev
Moscow Institute of Physics and Technology, Moscow, Russia
D
Dmitry Yudin
Moscow Institute of Physics and Technology, Moscow, Russia