Optical Tag-Based Neuronavigation and Augmentation System for Non-Invasive Brain Stimulation

2026-01-23

AI Summary

This study addresses the limitations of current transcranial magnetic stimulation (TMS) neuronavigation systems—namely high cost, operational complexity, and susceptibility to tracking errors—which compromise stimulation accuracy. To overcome these challenges, the authors propose a novel computer vision–based neuronavigation approach that integrates multi-camera optical tracking with visible fiducial markers to construct real-time digital twins of both the patient and the TMS coil. By leveraging augmented reality, the method projects personalized 3D brain models directly onto the patient’s head, enabling intuitive, abstraction-free coil positioning. This work represents the first integration of optical markers, digital twin technology, and AR visualization in TMS navigation, substantially improving spatial targeting precision while reducing system cost and user expertise requirements, thereby establishing an accessible and efficient new paradigm for non-invasive brain stimulation.

Technology Category

• Computer Vision: Multi-modal Vision
• Cognitive Modeling & Cognitive Systems: Neural Spike Coding
• Intelligent Robots: Multimodal Perception & Sensor Fusion

Application Category

• Responsible Web: Machine-in-the-loop, human agency and autonomy
• User Modeling, Personalization and Recommendation: On-Device user modeling, personalization, and recommendation
• Systems and Infrastructure for Web, Mobile and WoT: Applied ML and AI for Web-based mobile applications

Abstract

Accurate neuronavigation is critical for effective transcranial magnetic stimulation (TMS), as stimulation outcomes depend directly on precise coil placement. Existing neuronavigation systems are often costly, complex, and prone to tracking errors. To address these limitations, we present a computer vision based neuronavigation system that enables real time tracking of the patient and TMS instrumentation. The system integrates a multi camera optical tracking setup with consumer grade hardware and visible markers to drive a digital twin of the stimulation process. A dynamic 3D brain model in Unity updates in real time to visualize coil position and estimated stimulation targets. Augmented reality (AR) is further incorporated to project this model directly onto the patient's head, enabling intuitive, in situ coil adjustment without reliance on abstract numerical displays. Overall, the proposed approach improves spatial precision and accuracy while enhancing usability.

Problem

• neuronavigation
• transcranial magnetic stimulation
• tracking errors
• coil placement
• non-invasive brain stimulation

Innovation

• optical tag
• computer vision
• neuronavigation
• augmented reality
• digital twin