🤖 AI Summary
This work addresses the high cognitive load and comprehension difficulties readers often encounter due to the intricate interweaving of data tables and narrative text in scientific papers. To mitigate this, we propose TableTale—an enhanced reading interface that dynamically links textual content with tables across multiple granularities—paragraphs, sentences, and entity mentions—using a hierarchical intent framework and a multi-granularity semantic alignment mechanism. As readers progress through the document, TableTale progressively reveals contextual visual cues to support understanding. The system integrates a document-level automated linking algorithm with interactive visualization techniques to enable real-time synchronization between text and tables. User studies demonstrate that TableTale significantly reduces cognitive load and improves reading efficiency, confirming its effectiveness in facilitating the comprehension of complex academic literature.
📝 Abstract
Data tables play a central role in scientific papers. However, their meaning is often co-constructed with surrounding text through narrative interplay, making comprehension cognitively demanding for readers. In this work, we explore how interfaces can better support this reading process. We conducted a formative study that revealed key characteristics of text-table narrative interplay, including linking mechanisms, multi-granularity alignments, and mention typologies, as well as a layered framework of readers' intents. Informed by these insights, we present TableTale, an augmented reading interface that enriches text with data tables at multiple granularities, including paragraphs, sentences, and mentions. TableTale automatically constructs a document-level linking schema within the paper and progressively renders cascade visual cues on text and tables that unfold as readers move through the text. A within-subject study with 24 participants showed that TableTale reduced cognitive workload and improved reading efficiency, demonstrating its potential to enhance paper reading and inform future reading interface design.