🤖 AI Summary
This work addresses the challenges of reliability, efficiency, and scalability in tabular question answering under resource-constrained or privacy-sensitive settings. The authors propose MATA, a novel framework that integrates a multi-agent collaboration mechanism with diverse reasoning paths to generate candidate answers, followed by a lightweight filtering and refinement module powered by small language models. This design significantly reduces reliance on large language models (LLMs) while maintaining high performance. Evaluated across two benchmark datasets of varying difficulty and using ten different LLMs as backbones, MATA consistently achieves state-of-the-art accuracy and demonstrates highly efficient inference, thereby enhancing both system flexibility and practical applicability without compromising performance.
📝 Abstract
Recent advances in Large Language Models (LLMs) have significantly improved table understanding tasks such as Table Question Answering (TableQA), yet challenges remain in ensuring reliability, scalability, and efficiency, especially in resource-constrained or privacy-sensitive environments. In this paper, we introduce MATA, a multi-agent TableQA framework that leverages multiple complementary reasoning paths and a set of tools built with small language models. MATA generates candidate answers through diverse reasoning styles for a given table and question, then refines or selects the optimal answer with the help of these tools. Furthermore, it incorporates an algorithm designed to minimize expensive LLM agent calls, enhancing overall efficiency. MATA maintains strong performance with small, open-source models and adapts easily across various LLM types. Extensive experiments on two benchmarks of varying difficulty with ten different LLMs demonstrate that MATA achieves state-of-the-art accuracy and highly efficient reasoning while avoiding excessive LLM inference. Our results highlight that careful orchestration of multiple reasoning pathways yields scalable and reliable TableQA. The code is available at https://github.com/AIDAS-Lab/MATA.