Towards Hierarchical Structure Understanding of Newspaper Images
This study addresses the challenges of document understanding in historical newspaper images, which exhibit complex nested structures and densely heterogeneous layouts. To tackle this problem, the authors propose two complementary approaches: a modular bottom-up pipeline integrating YOLO-based layout detection, LayoutReader for reading order prediction, and a custom article segmentation algorithm; and Tiramisu, a novel end-to-end hierarchical Transformer architecture that explicitly models the multi-level structure of newspapers through an iterative hierarchical mechanism. The work also contributes Finlam La Liberté, the first dataset tailored for hierarchical information retrieval in historical newspapers, along with open-sourced training code and a synthetic newspaper generator. Experimental results demonstrate that both methods effectively reconstruct intricate newspaper hierarchies, offering significant advantages for scalable document digitization.