Classification of Vision-Based Tactile Sensors: A Review

2025-09-02

AI Summary

Current vision-based tactile sensors (VBTS) lack a unified classification standard across design principles, material systems, multimodal fusion, and data interpretation. To address this, this paper proposes, for the first time, a transduction-mechanism-based classification framework: VBTS are systematically categorized into two primary types—marker-based and intensity-based—according to the physical pathway by which contact information is converted into tactile images; these are further subdivided into four sub-mechanisms: simple marker, morphological marker, reflective-layer, and transparent-layer. The framework holistically integrates hardware structural modeling, image analysis, and multimodal data fusion techniques, revealing intrinsic trade-offs among sensitivity, spatial resolution, robustness, and application suitability across mechanisms. This work establishes the first engineering-oriented VBTS classification standard, enabling principled sensor selection, cross-platform data interpretation, and informed development of next-generation soft tactile systems.

Technology Category

• Intelligent Robots: Multimodal Perception & Sensor Fusion
• Computer Vision: Multi-modal Vision
• Humans and AI: Brain-Sensing and Analysis

Application Category

• Systems and Infrastructure for Web, Mobile and WoT: Virtualization and resource management in Web systems and infrastructures
• Security and Privacy: Data transparency and provenance
• User Modeling, Personalization and Recommendation: Accountability, Transparency, and Ethics for personalization

Abstract

Vision-based tactile sensors (VBTS) have gained widespread application in robotic hands, grippers and prosthetics due to their high spatial resolution, low manufacturing costs, and ease of customization. While VBTSs have common design features, such as a camera module, they can differ in a rich diversity of sensing principles, material compositions, multimodal approaches, and data interpretation methods. Here, we propose a novel classification of VBTS that categorizes the technology into two primary sensing principles based on the underlying transduction of contact into a tactile image: the Marker-Based Transduction Principle and the Intensity-Based Transduction Principle. Marker-Based Transduction interprets tactile information by detecting marker displacement and changes in marker density. In contrast, Intensity-Based Transduction maps external disturbances with variations in pixel values. Depending on the design of the contact module, Marker-Based Transduction can be further divided into two subtypes: Simple Marker-Based (SMB) and Morphological Marker-Based (MMB) mechanisms. Similarly, the Intensity-Based Transduction Principle encompasses the Reflective Layer-based (RLB) and Transparent Layer-Based (TLB) mechanisms. This paper provides a comparative study of the hardware characteristics of these four types of sensors including various combination types, and discusses the commonly used methods for interpreting tactile information. This~comparison reveals some current challenges faced by VBTS technology and directions for future research.

Problem

• Classifying vision-based tactile sensors by sensing principles
• Comparing hardware characteristics of different sensor types
• Identifying challenges and future research directions for VBTS

Innovation

• Marker-Based Transduction Principle for tactile sensing
• Intensity-Based Transduction Principle using pixel variations
• Four subtypes: SMB, MMB, RLB, and TLB mechanisms