🤖 AI Summary
This work addresses the lack of systematic evaluation of visual large language models (VLMs) on the cross-era morphological evolution of Chinese characters, as existing datasets are typically confined to a single historical period. To bridge this gap, we introduce Chronicles-OCR, the first cross-temporal visual perception benchmark encompassing the complete evolutionary trajectory of the “Seven Scripts” of Chinese writing. In collaboration with domain experts, we curated a balanced set of 2,800 images spanning diverse physical media—from oracle bones to paper-based calligraphy. Employing a phase-adaptive annotation paradigm and four quantitative tasks—character localization, fine-grained recognition, text parsing, and script classification—we effectively disentangle visual perception from semantic reasoning. Chronicles-OCR provides the first systematic modeling of diachronic character morphology and topological shifts, revealing critical limitations of current VLMs in historical script perception and establishing a rigorous foundation for evaluating their temporal-aware visual understanding capabilities.
📝 Abstract
Vision Large Language Models (VLLMs) have achieved remarkable success in modern text-rich visual understanding. However, their perceptual robustness in the face of the continuous morphological evolution of historical writing systems remains largely unexplored. Existing ancient text datasets typically focus on isolated historical periods, failing to capture the systematic visual distribution shifts spanning thousands of years. To bridge this gap and empower Digital Humanities, we introduce Chronicles-OCR, the first comprehensive benchmark specifically designed to evaluate the cross-temporal visual perception capabilities of VLLMs across the complete evolutionary trajectory of Chinese characters, known as the Seven Chinese Scripts. Curated in collaboration with top-tier institutional domain experts, the dataset comprises 2,800 strictly balanced images encompassing highly diverse physical media, ranging from tortoise shells to paper-based calligraphy. To accommodate the drastic morphological and topological variations across different historical stages, we propose a novel Stage-Adaptive Annotation Paradigm. Based on this, Chronicles-OCR formulates four rigorous quantitative tasks: cross-period character spotting, fine-grained archaic character recognition via visual referring, ancient text parsing, and script classification. By isolating visual perception from semantic reasoning, Chronicles-OCR provides an authoritative platform to expose the limitations of current VLLMs, paving the way for robust, evolution-aware historical text perception. Chronicles-OCR is publicly available at https://github.com/VirtualLUOUCAS/Chronicles-OCR.