MRATTS: An MR-Based Acupoint Therapy Training System with Real-Time Acupoint Detection and Evaluation Standards

2026-03-24

AI Summary

This work proposes a mixed reality–based training system for traditional Chinese medicine acupoint therapy that addresses the limitations of existing approaches, which struggle to achieve accurate real-time acupoint detection and visualization on actual human bodies and lack fine-grained instructional guidance and evaluation criteria for diverse acupuncture and moxibustion techniques. The system enables, for the first time, real-time detection and three-dimensional visualization of acupoints on the hands, limbs, and torso, and incorporates interactive visual guidance to simulate various needling and moxibustion manipulations. Furthermore, it introduces a theory-driven assessment framework grounded in traditional Chinese medicine principles to quantitatively evaluate both accuracy and proficiency. User studies demonstrate that trainees using the system exhibit significantly improved understanding of three-dimensional acupoint localization and enhanced procedural skills compared to a control group, confirming the system’s effectiveness and practical utility.

Technology Category

• Cognitive Modeling & Cognitive Systems: Applications
• Machine Learning: Calibration & Uncertainty Quantification
• Humans and AI: Interaction Techniques and Devices

Application Category

• User Modeling, Personalization and Recommendation: User modeling and simulation for interactive and conversational systems
• Systems and Infrastructure for Web, Mobile and WoT: Applied ML and AI for Web-based mobile applications
• Search and Retrieval-Augmented AI: Web evaluation methodologies and metrics

Abstract

Acupoint therapy is a core therapeutic method of Traditional Chinese Medicine (TCM), and it requires a high level of expertise and skills to detect acupoints and perform acupuncture and moxibustion. Existing mixed reality (MR)-based training methods often fall short in accurate real-time detection and visualization of acupoints on the hand, limb, or torso of a real person and do not support various techniques of acupuncture and moxibustion. Moreover, evaluation standards and visual guidance with fine details for each step during MR-based training are typically missing. To this end, we propose the MR-based TCM Acupoint Therapy Teaching System (MRATTS)--an MR-based acupoint therapy teaching and training framework. MRATTS is based on a real-time hand, limb, and torso acupoint detection method to accurately track and visualize acupoints on real patients through MR. On top of that, in collaboration with an experienced acupoint therapist, we design a practice method with interactive visual guidance for various acupoint therapy techniques that simulate acupressure, acupuncture (insertion, lifting-thrusting, and twisting), and moxibustion (mild, sparrow-pecking, and whirling). A set of TCM theory-based evaluation standards is formulated within MRATTS to enable the scoring and visualization of the accuracy and proficiency of acupoint therapy. The effectiveness and usefulness of MRATTS are evaluated through a controlled user study and expert feedback. Results of the study indicate that the MRATTS group shows clear improvements in understanding 3D locations of acupoints and proficiency in acupoint therapy compared to control groups.

Problem

• acupoint therapy
• mixed reality
• real-time detection
• evaluation standards
• Traditional Chinese Medicine

Innovation

• Mixed Reality
• Real-Time Acupoint Detection
• Interactive Visual Guidance
• TCM Evaluation Standards
• Acupoint Therapy Training