Two Explorative Studies on Tangible Augmented Reality for Neurodevelopmental Disorders

2025-10-16

AI Summary

This study addresses the critical need for life-skills and motor-cognitive training in individuals with neurodevelopmental disorders (NDDs). We designed and implemented two tactile augmented reality (TAR) intervention systems: *Holomarket*, targeting shopping, arithmetic, and money management; and *Along the Oceanic Flow*, focusing on motor coordination and executive function. Both systems integrate tangible interaction objects, spatially registered AR environments, and head-mounted displays to enable personalized, immersive task-based rehabilitation. User evaluations demonstrated high levels of presence, strong interaction acceptance, and excellent usability—indicating substantial clinical potential. Key usability challenges identified include virtual-to-physical action mapping fidelity and headset ergonomics. To our knowledge, this is the first work to systematically introduce customizable TAR paradigms into functional NDD rehabilitation, establishing a novel methodology and empirical foundation for digital therapeutics in this domain.

Technology Category

• Humans and AI: Interaction Techniques and Devices
• Cognitive Modeling & Cognitive Systems: Adaptive Behavior
• Intelligent Robots: Human-Robot Interaction

Application Category

• Responsible Web: Machine-in-the-loop, human agency and autonomy
• Systems and Infrastructure for Web, Mobile and WoT: Web applications in cross-disciplinary domains and verticals such as mixed reality, smart cities, and digital health
• Search and Retrieval-Augmented AI: Personalized, context-aware and across-device search

Abstract

Tangible Augmented Reality (TAR) is an interaction paradigm that integrates physical and digital worlds to create immersive, interactive experiences. This paper explores two TAR applications, Holomarket and Along the Oceanic Flow (ATOF), and presents insights from two exploratory studies evaluating their usability and likeability among individuals with neurodevelopmental disorders (NDD). Holomarket is designed to simulate a supermarket shopping experience, helping users develop essential life skills such as item selection, basic arithmetic, and money handling. Participants interacted with augmented food items and a smart cash register, navigating a virtual supermarket environment. While participants enjoyed the realistic setting and tangible interactions, some usability challenges, such as difficulty manipulating virtual objects and discomfort with prolonged headset use, were noted. ATOF transforms the user environment into an oceanic world, where participants use a dolphin-shaped smart object to complete tasks like collecting items and solving puzzles. This application aims to improve motor coordination and cognitive skills. Participants appreciated the immersive experience, the customizable tasks, and the tangible dolphin interface. However, some faced difficulties interacting with specific virtual elements. Overall, both applications demonstrated potential as therapeutic tools for NDD, offering engaging and immersive experiences. Despite some usability challenges and hardware limitations, the positive feedback suggests that TAR could play a crucial role in future therapeutic interventions. Further research is needed to refine these applications and enhance user interaction and comfort.

Problem

• Exploring tangible augmented reality for neurodevelopmental disorder therapeutic interventions
• Evaluating usability and engagement of TAR applications for skill development
• Addressing interaction challenges in immersive environments for individuals with NDD

Innovation

• Tangible Augmented Reality integrates physical and digital worlds
• Holomarket simulates shopping for life skills training
• ATOF uses dolphin-shaped object for motor and cognitive tasks