MRUCT: Mixed Reality Assistance for Acupuncture Guided by Ultrasonic Computed Tomography

2025-02-12

AI Summary

Clinical acupuncture practice and education have long suffered from the absence of real-time anatomical visualization, forcing novices to rely on trial-and-error learning—resulting in high localization errors and prolonged training periods. To address this, we propose the first integrated ultrasound computed tomography (UCT) and mixed reality (MR) needle-navigation framework. Our method introduces a novel UCT-MR coupling architecture, a non-rigid image registration technique for dynamic soft-tissue modeling, and a dual-mode clinical workflow combining offline anatomical registration with real-time MR-guided intervention. This workflow integrates SLAM-based tracking, MR spatial anchoring, and dual-paradigm 3D user interfaces. Experimental evaluation demonstrates a 42% reduction in acupoint localization error, significantly improving novice procedural accuracy and learning efficiency. Comparative studies further validate the optimal human–computer interaction paradigm.

Technology Category

• Intelligent Robots: Localization, Mapping, and Navigation
• Machine Learning: Calibration & Uncertainty Quantification
• Computer Vision: Multi-modal Vision

Application Category

• Responsible Web: Machine-in-the-loop, human agency and autonomy
• User Modeling, Personalization and Recommendation: Accountability, Transparency, and Ethics for personalization
• Graph Algorithms and Modeling for the Web: Efficient manipulation of static and dynamic Web-related graphs

Abstract

Chinese acupuncture practitioners primarily depend on muscle memory and tactile feedback to insert needles and accurately target acupuncture points, as the current workflow lacks imaging modalities and visual aids. Consequently, new practitioners often learn through trial and error, requiring years of experience to become proficient and earn the trust of patients. Medical students face similar challenges in mastering this skill. To address these challenges, we developed an innovative system, MRUCT, that integrates ultrasonic computed tomography (UCT) with mixed reality (MR) technology to visualize acupuncture points in real-time. This system offers offline image registration and real-time guidance during needle insertion, enabling them to accurately position needles based on anatomical structures such as bones, muscles, and auto-generated reference points, with the potential for clinical implementation. In this paper, we outline the non-rigid registration methods used to reconstruct anatomical structures from UCT data, as well as the key design considerations of the MR system. We evaluated two different 3D user interface (3DUI) designs and compared the performance of our system to traditional workflows for both new practitioners and medical students. The results highlight the potential of MR to enhance therapeutic medical practices and demonstrate the effectiveness of the system we developed.

Problem

• Visualize acupuncture points in real-time
• Enhance needle insertion accuracy
• Improve learning for new practitioners

Innovation

• Mixed Reality Technology
• Ultrasonic Computed Tomography
• Real-time Acupuncture Guidance