Sound of Touch: Active Acoustic Tactile Sensing via String Vibrations

2026-02-18

AI Summary

This work addresses the challenges of large-scale distributed tactile sensing—namely, the wiring complexity, high cost, and fragility of dense sensor arrays, as well as the trade-off between coverage and dynamic interaction capture in existing alternatives. The authors propose an active acoustic tactile sensing approach based on tensioned string vibrations: by electromagnetically exciting strings and using a sparse array of microphones to detect contact-induced spectral shifts, the system enables contact localization, normal force estimation, and slip detection. Key contributions include a lightweight and scalable string-based hardware architecture, a physics-informed string vibration simulation framework, and an inference pipeline combining spectral analysis with real-time machine learning. Experiments demonstrate millimeter-level localization accuracy, reliable force estimation, and real-time slip detection over large robotic surfaces, validating the method’s feasibility and scalability.

Technology Category

• Intelligent Robots: Multimodal Perception & Sensor Fusion
• Planning, Routing, and Scheduling: Activity and Plan Recognition
• Computer Vision: Low Level & Physics-based Vision

Application Category

• Systems and Infrastructure for Web, Mobile and WoT: Experiences and lessons learnt from Web-based algorithms and system deployments
• Security and Privacy: Large-scale security measurements
• Responsible Web: Human-perceived consequences of algorithmic deployment on the web

Abstract

Distributed tactile sensing remains difficult to scale over large areas: dense sensor arrays increase wiring, cost, and fragility, while many alternatives provide limited coverage or miss fast interaction dynamics. We present Sound of Touch, an active acoustic tactile-sensing methodology that uses vibrating tensioned strings as sensing elements. The string is continuously excited electromagnetically, and a small number of pickups (contact microphones) observe spectral changes induced by contact. From short-duration audio signals, our system estimates contact location and normal force, and detects slip. To guide design and interpret the sensing mechanism, we derive a physics-based string-vibration simulator that predicts how contact position and force shift vibration modes. Experiments demonstrate millimeter-scale localization, reliable force estimation, and real-time slip detection. Our contributions are: (i) a lightweight, scalable string-based tactile sensing hardware concept for instrumenting extended robot surfaces; (ii) a physics-grounded simulation and analysis tool for contact-induced spectral shifts; and (iii) a real-time inference pipeline that maps vibration measurements to contact state.

Problem

• distributed tactile sensing
• scalability
• contact dynamics
• large-area coverage
• sensor fragility

Innovation

• active acoustic sensing
• string vibration
• tactile sensing
• physics-based simulation
• slip detection