🤖 AI Summary
This work addresses the insufficient evaluation of large language models’ (LLMs) reasoning capabilities in spatiotemporal analysis of Automatic Identification System (AIS) data. We conduct the first systematic comparison of four inference paradigms: natural-language interfaces, raw-data reasoning, compressed-trajectory reasoning, and semantic-trajectory reasoning. To bridge this gap, we propose a novel semantic-trajectory reasoning framework tailored to maritime scenarios, integrating vessel state recognition (anchoring vs. sailing) with trajectory semantic modeling. Our approach unifies LLaMA/GPT-family LLMs, spatial database interfaces, and the Douglas–Peucker trajectory compression algorithm. Experiments demonstrate that semantic-trajectory reasoning achieves significantly higher accuracy and interpretability than alternative paradigms; meanwhile, natural-language interfaces enable zero-code spatial querying. We further establish a method-selection guidance framework, providing the first empirical benchmark and reusable best-practice guidelines for AI-driven maritime analytics.
📝 Abstract
Recent research in Large Language Models (LLMs), has had a profound impact across various fields, including mobility data science. This paper explores the and experiment with different approaches to using LLMs for analyzing AIS data. We propose a set of carefully designed queries to assess the reasoning capabilities of LLMs in this kind of tasks. Further, we experiment with four different methods: (1) using LLMs as a natural language interface to a spatial database, (2) reasoning on raw data, (3) reasoning on compressed trajectories, and (4) reasoning on semantic trajectories. We investigate the strengths and weaknesses for the four methods, and discuss the findings. The goal is to provide valuable insights for both researchers and practitioners on selecting the most appropriate LLM-based method depending on their specific data analysis objectives.