How Does Empirical Research Facilitate Creation Tool Design? A Data Video Perspective

2025-07-21

AI Summary

A persistent gap exists between empirical research and tool development in data visualization. This paper addresses this gap by examining data videos as a case study. We systematically review 46 empirical papers and 48 tool-oriented papers, and conduct interviews with 11 domain experts to construct a classification framework elucidating how empirical findings inform tool design—specifically in problem framing, technology selection, and feature implementation. Employing a mixed-methods approach—including corpus analysis, contextual citation analysis, and structured feature characterization—we identify recurring citation patterns and key factors governing the applicability of empirical insights. Our work clarifies the practical mechanisms through which empirical results translate into design decisions and proposes actionable strategies to foster deeper synergy between empirical and tool-development research. The findings provide both an evidence-based foundation and practical guidance for theory-driven design of data storytelling tools. (149 words)

Technology Category

• Data Mining & Knowledge Management: Data Visualization & Summarization
• Constraint Satisfaction and Optimization: Solvers and Tools
• Knowledge Representation and Reasoning: Geometric, Spatial, and Temporal Reasoning

Application Category

• Web Mining and Content Analysis: Web data visualization
• Security and Privacy: Data transparency and provenance
• User Modeling, Personalization and Recommendation: Practical large-scale studies of user experience

Abstract

Empirical research in creative design deepens our theoretical understanding of design principles and perceptual effects, offering valuable guidance for innovating creation tools. However, how these empirical insights currently influence the development of creation tools, and how their integration can be enhanced in the future, remains insufficiently understood. In this paper, we aim to unveil the gap through a case study on data videos, a prominent and wide-spread medium for effective data storytelling. To achieve the goal, we conducted a comprehensive analysis of 46 empirical research papers and 48 creation tool papers on data video, complemented by interviews with 11 experts. Building upon a systematic collection and structured characterization of empirical research by their methodologies (e.g., corpus analysis, comparative evaluations) and component focus (e.g., visuals, motions, narratives, audio), we conducted a context-aware citation analysis and revealed a taxonomy of recurring patterns in how empirical findings inform tool design across citation functions (e.g., problem framing, technical reference). Expert interviews further uncovered researchers' practice patterns in applying empirical findings (e.g., adaptation, synthesis, iteration, etc.) and identified key factors influencing applicability, such as contextual relevance, granularity matching, clarity, credibility, and feasibility. Finally, we derive suggestions and discuss future opportunities to foster closer mutual engagement between empirical and tool research, aiming to reinforce the theoretical grounding of creation tools and enhance the practical impact of empirical research.

Problem

• Understanding how empirical research influences data video tool design
• Identifying gaps between empirical insights and creation tool development
• Exploring methods to enhance empirical research integration in design

Innovation

• Conducted context-aware citation analysis
• Systematically characterized empirical research methodologies
• Identified key factors influencing empirical findings applicability