🤖 AI Summary
This study addresses the challenge of limited downlink bandwidth in Earth observation satellites, which often causes delays or loss of high-resolution remote sensing data, thereby compromising time-sensitive applications. To overcome this, the authors propose a semantic-driven downlink paradigm—“summarize first, download later”—wherein a lightweight vision-language model is deployed onboard to generate natural language summaries of acquired imagery. Ground users then interactively verify critical information via visual question answering (VQA) and selectively request full-resolution images only when necessary. This approach pioneers the integration of vision-language models and interactive VQA into space-to-ground communications, shifting from passive bulk transmission to semantic-aware, active dialogue. Experiments on an NVIDIA Jetson platform demonstrate that the proposed method substantially reduces bandwidth consumption while accelerating information retrieval for time-critical tasks.
📝 Abstract
Modern Earth observation (EO) satellites carry increasingly advanced sensors that produce vast volumes of high-resolution, multispectral data, yet downlink capacity remains a critical bottleneck -- often causing significant latency or the loss of valuable observations within limited contact windows. We propose a "Summarize First, Download Later" paradigm that exploits recent advances in onboard edge computing and Vision-Language Models (VLMs). Rather than indiscriminately downlinking raw imagery, the system follows a three-phase interaction protocol: the satellite first transmits concise natural language summaries generated by a quantized onboard VLM; ground operators then issue targeted Visual Question Answering (VQA) queries to verify scene relevance (e.g., wildfires or maritime anomalies); and full-resolution images are downloaded only when critical information is confirmed. This transforms the downlink from passive bulk transfer into an active, semantics-aware dialogue. We implement and evaluate the system on a resource-constrained NVIDIA Jetson platform, and experiments on diverse remote sensing scenes show that the proposed strategy substantially reduces bandwidth consumption while accelerating time-to-insight for time-sensitive missions.