Capability-Routed Visual Retrieval and Evidence Threading for Long-Context Document Question Answering

📅 2026-09-07
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
研究解决了长文档中视觉信息检索和问答问题,通过引入能力感知视觉路由、弱到强页面选择和视觉证据线程方法,提升了系统在多种任务上的性能。
📝 Abstract
Annual reports, diligence packs, and infographic dashboards bury numbers in page images: axes, cell grids, and footnotes that OCR pipelines flatten and that page-level visual retrievers still treat as interchangeable in-context examples. We keep a frozen Qwen2.5-VL-7B-Instruct generator and a ColPali / VisRAG-Ret page index, and insert three modules. A capability-aware visual router (CAVR) tags each retrieved page as text, table, chart, layout, or mixed and mixes specialist experts before generation. Weak-to-strong page selection (WSPS) distils a frozen 7B answerability teacher into a 3B selection head so ranking is no longer a single InfoNCE score. Visual evidence threading (VET) builds layout-anchored paths of length at most three and lets the generator read the thread rather than a flat top-$k$ list. On gold-page DocVQA / ChartQA / InfographicVQA the 7B system reaches 96.3 / 90.1 / 85.4. Under the VisRAG top-3 protocol the mean generation accuracy is 62.74 versus 59.39 for the same backbone with concatenation. On MMLongBench-Doc retrieve-then-read, F1 moves from 19.2 to 22.6 and multi-page accuracy from 16.4 to 21.2. ViDoRe nDCG@5 after WSPS reranking is 83.6, with TAT-DQA financial reports at 70.4.
Problem

Research questions and friction points this paper is trying to address.

Visual Retrieval
Document Question Answering
Page Images
Innovation

Methods, ideas, or system contributions that make the work stand out.

capability-aware visual router
weak-to-strong page selection
visual evidence threading
💼 Related Jobs
No related jobs found.
A
Amirul Rahman
University of Malaya
A
Aisha Karim
University of Malaya
K
Kenji Nakamura
University of Malaya
Y
Yi-Fan Ng
University of Malaya