From Following to Understanding: Investigating the Role of Reflective Prompts in AR-Guided Tasks to Promote Task Understanding

2025-01-22

AI Summary

This study addresses the prevalent issue of rote interaction and shallow conceptual understanding among middle school students performing augmented reality (AR) learning tasks. To mitigate this, we propose a design strategy embedding reflective prompts—specifically hypothetical questions and causal scaffolding—into AR interfaces. Using a mixed-methods approach, we first iteratively refined the prompt mechanism via formative surveys and co-design workshops (N=9), then conducted a within-subject experimental study (N=16) across two AR tasks: coffee brewing and circuit assembly. Results demonstrate that reflective prompts significantly improve objective conceptual understanding (+37% accuracy), increase proactive information seeking (2.1× more frequent consultation of supplementary resources), and maintain operational efficiency (no significant increase in task completion time). This work provides the first systematic empirical evidence for the efficacy of reflective prompting in AR-based learning and offers empirically grounded design guidelines that jointly optimize conceptual depth and procedural fluency.

Technology Category

• Humans and AI: Interaction Techniques and Devices
• Cognitive Modeling & Cognitive Systems: Affective Computing
• Knowledge Representation and Reasoning: Argumentation

Application Category

• Search and Retrieval-Augmented AI: Web learning to rank, online learning, and counterfactual learning for ranking
• Responsible Web: Machine-in-the-loop, human agency and autonomy
• Semantics and Knowledge: Methods to enhance, augment, integrate or synergize semantic models such as knowledge graphs and LLMs

Abstract

Augmented Reality (AR) is a promising medium for guiding users through tasks, yet its impact on fostering deeper task understanding remains underexplored. This paper investigates the impact of reflective prompts -- strategic questions that encourage users to challenge assumptions, connect actions to outcomes, and consider hypothetical scenarios -- on task comprehension and performance. We conducted a two-phase study: a formative survey and co-design sessions (N=9) to develop reflective prompts, followed by a within-subject evaluation (N=16) comparing AR instructions with and without these prompts in coffee-making and circuit assembly tasks. Our results show that reflective prompts significantly improved objective task understanding and resulted in more proactive information acquisition behaviors during task completion. These findings highlight the potential of incorporating reflective elements into AR instructions to foster deeper engagement and learning. Based on data from both studies, we synthesized design guidelines for integrating reflective elements into AR systems to enhance user understanding without compromising task performance.

Problem

• AR technology
• reflective prompts
• task comprehension

Innovation

• Augmented Reality (AR)
• Reflective Prompts
• Active Learning