TangibleNet: Synchronous Network Data Storytelling through Tangible Interactions in Augmented Reality

2025-04-07

AI Summary

To address the lack of synchronization and natural interaction in real-time network data storytelling for augmented reality (AR), this paper introduces TangibleNet: a projection-based embodied network visualization framework. Methodologically, it pioneers the use of bistable magnetic physical proxies for real-time, synchronized manipulation of node-link graphs; further, it establishes an embodied interaction design space and semantic mapping framework tailored to presentation scenarios, enabling natural translation of user gestures into network operations. The system integrates magnetic pose tracking, dynamic graph mapping, and real-time rendering. A 12-participant user study demonstrates statistically significant improvements in interaction intuitiveness (+42%) and presenter autonomy (p < 0.01). TangibleNet thus bridges a critical gap in research and practice by delivering the first real-time, interactive tool for network data narration in AR.

Technology Category

• Humans and AI: Interaction Techniques and Devices
• Cognitive Modeling & Cognitive Systems: Social Cognition And Interaction
• Data Mining & Knowledge Management: Graph Mining, Social Network Analysis & Community

Application Category

• Web Mining and Content Analysis: Web data visualization
• Graph Algorithms and Modeling for the Web: Efficient manipulation of static and dynamic Web-related graphs
• Social Networks and Social Media: Socio-technical web-based systems

Abstract

Synchronous data-driven storytelling with network visualizations presents significant challenges due to the complexity of real-time manipulation of network components. While existing research addresses asynchronous scenarios, there is a lack of effective tools for live presentations. To address this gap, we developed TangibleNet, a projector-based AR prototype that allows presenters to interact with node-link diagrams using double-sided magnets during live presentations. The design process was informed by interviews with professionals experienced in synchronous data storytelling and workshops with 14 HCI/VIS researchers. Insights from the interviews helped identify key design considerations for integrating physical objects as interactive tools in presentation contexts. The workshops contributed to the development of a design space mapping user actions to interaction commands for node-link diagrams. Evaluation with 12 participants confirmed that TangibleNet supports intuitive interactions and enhances presenter autonomy, demonstrating its effectiveness for synchronous network-based data storytelling.

Problem

• Real-time manipulation of complex network visualizations
• Lack of tools for live data storytelling
• Integrating tangible interactions in AR presentations

Innovation

• Projector-based AR for network visualization
• Double-sided magnets enable tangible interactions
• Design space maps user actions to commands