V2TATC: A Joint Voice-Trajectory Embedding Framework and Dataset for Air Traffic Controller Situational Awareness

📅 2026-08-28
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
为提高空中交通管制员的情境意识,本文提出V2TATC框架,通过联合嵌入语音通信和飞行轨迹数据来解决低空域拥堵问题。
📝 Abstract
As air traffic volumes in the National Airspace System continue to expand, in particular in the low altitude airspaces, the need for scalable decision support tools used by air traffic controllers will also require more development. This article introduces Voice-to-Trajectory for Air Traffic Control, a joint voice communication-flight trajectory data embedding framework, that can be a component of situational awareness in congested airspaces, and assist the development of tools for ATC as they reason in real-time over Automatic Dependent Surveillance-Broadcast trajectories, or the intent expressed by pilots in natural language. We show that these data modalities are not independent and represent a common physical referent: an aircraft flying through the airspace. V2TATC maps a voice instruction and the trajectory of the addressed aircraft to nearby points in a single latent space that can be queried in both directions. It combines a self-supervised trajectory encoder, a frozen large-scale speech encoder, a contrastive joint embedding, and a bijective lifting via normalizing flows. We demonstrate V2TATC's effectiveness on the San Francisco Bay Area, for its concentration of major airports, and its mix of commercial and general aviation low altitude traffic. Lastly, we release a novel paired voice-trajectory dataset, and report experiments on cross-modal retrieval, ablations, and latent-space analysis.
Problem

Research questions and friction points this paper is trying to address.

air traffic control
situational awareness
voice communication
flight trajectory
decision support tools
Innovation

Methods, ideas, or system contributions that make the work stand out.

joint voice-trajectory embedding
self-supervised learning
contrastive learning
normalizing flows
🔎 Similar Papers
No similar papers found.
L
Louis Brusset
Mines Paris–PSL University, Paris, 75006, France
M
Mathurin Petit
École Polytechnique, Palaiseau, 91128, France
J
Jordan Kam
California Institute of Technology, Pasadena, CA, 91125, USA
Alexandre Bayen
Alexandre Bayen
Professor Electrical Engineering and Computer Science, UC Berkeley
controloptimizationmobile sensingcrowdsourcingtraffic