MISTac: A Vision-Based Tactile Sensor for Minimally Invasive Surgery

2026-08-14

AI Summary

This study addresses the lack of tactile feedback in minimally invasive surgery by developing Mistac, a visuo-tactile sensor featuring an 8 mm modular, replaceable probe design that facilitates hardware iteration and open-source validation. By integrating high-resolution visuo-tactile sensing with machine learning algorithms, the system enables real-time intraoperative tissue classification. Experimental results demonstrate a tactile resolution of 250 μm, a minimum force detection threshold of 24.3 mN, and a tissue classification accuracy of 84%. This work effectively restores tactile perception capabilities in minimally invasive procedures, providing a high-precision and scalable tactile sensing solution for intelligent surgical instruments.

Abstract

Minimally invasive and robot-assisted surgery offer many advantages over traditional open surgery, but deprive surgeons of tactile feedback and the ability to palpate tissue with their fingers. To address this lack of tactile feedback, we introduce the MISTac, a high resolution vision-based tactile sensor specifically designed for palpation in MIS. The sensor has a replaceable sensor tip with a diameter of 8 mm which allows it to fit through the trocars used in minimally invasive surgery. Its modular 3D-printed case design allows the use of bulky off-the-shelf illumination and imaging hardware that can easily be exchanged and upgraded. The sensor has an optical resolution of 176.68 $μm$, a tactile resolution of 250 $μm$, and can resolve forces as little as 24.3 mN. An in vivo study with the sensor shows its usability in minimally invasive surgery. We trained a machine learning model with the tactile data collected in the trial on a tissue classification task achieving an aggregate accuracy of ~84% in a leave-one-out cross validation. Tactile sensors have the potential to one day aid surgeons during minimally invasive surgery with tasks such as tissue classification or intra-operative tumor localization; MISTac is a small step towards this vision. We open-source MISTac at https://github.com/lasr-lab/mistac

Problem

• Minimally Invasive Surgery
• Tactile Feedback
• Palpation
• Robot-Assisted Surgery

Innovation

• Vision-based tactile sensor
• Minimally invasive surgery
• Modular design
• Tissue classification
• Open-source hardware