Talking to Your Data: Exploring Embodied Conversation as an Interface for Personal Health Reflection

2026-06-16

AI Summary

This study addresses the limitations of traditional wearable health data visualizations, which often rely on static charts and lack intuitive, interactive mechanisms for user reflection. To overcome this, the authors propose a novel “embodied dialogue” paradigm featuring a dual-agent architecture—comprising an Observer and a Presenter—that integrates lightweight data preprocessing with conversational statistical summarization. Implemented in Unity, the embodied dialogue agent translates objective health trends into natural language narratives while deliberately avoiding clinical recommendations. A user study (N=5) demonstrates that, compared to conventional dashboards, this approach significantly enhances users’ comprehension of their data and the concreteness of their intended actions, fostering a cognitive shift from passive data viewing toward active meaning-making.

Abstract

Personal health data from wearables are typically presented through dashboards of charts and summary statistics, requiring users to actively interpret patterns and implications. We explore an alternative interaction paradigm: engaging with personal health data through an embodied conversational agent that facilitates objective data reflection in dialogue with the user. We present a system that combines lightweight preprocessing of wearable data with a Unity-based embodied character. Internally, the system follows a dual-agent design in which an Observer agent extracts descriptive statistics and temporal trends, and a Presenter agent communicates these findings through "spoken statistics," intentionally refraining from clinical advice to isolate the impact of the interaction modality. We evaluate this approach through a simulated-self user study (N=5) using a within-subject design. Participants adopted health personas and goals derived from the LifeSnaps dataset to compare traditional dashboard exploration with embodied conversational reflection. Our evaluation focuses on perceived understanding, the specificity of generated actions, and the cognitive shift from passive viewing to active sensemaking. The paper contributes a functional prototype, a design pattern for objective health data narrative generation, and early empirical insights into how embodiment affects the interpretation of personal health metrics.

Problem

• personal health data
• embodied conversation
• data reflection
• wearable devices
• human-computer interaction

Innovation

• embodied conversational agent
• dual-agent architecture
• spoken statistics
• health data reflection
• objective narrative generation