Soft Surfaced Vision-Based Tactile Sensing for Bipedal Robot Applications

2026-02-20

AI Summary

This work addresses the challenge of stable locomotion for bipedal robots on complex terrains, which is hindered by the lack of tactile foot sensing. To this end, the study presents the first integration of a skin-inspired soft visuotactile sensor into robotic feet, enabling real-time optical imaging of contact deformations. The system simultaneously estimates contact pose, shear force distribution, and center of pressure, while also identifying terrain type and geometric features of the contact area. By leveraging this multimodal tactile information, the approach significantly enhances the robot’s proprioception, terrain understanding, and dynamic balance under challenging conditions such as visual occlusion and inclined surfaces, demonstrating effective extraction and utilization of rich foot-ground interaction data.

Technology Category

• Intelligent Robots: Multimodal Perception & Sensor Fusion
• Computer Vision: Multi-modal Vision
• Humans and AI: Brain-Sensing and Analysis

Application Category

• Systems and Infrastructure for Web, Mobile and WoT: Experiences and lessons learnt from Web-based algorithms and system deployments
• Security and Privacy: Data transparency and provenance
• Responsible Web: Human-perceived consequences of algorithmic deployment on the web

Abstract

Legged locomotion benefits from embodied sensing, where perception emerges from the physical interaction between body and environment. We present a soft-surfaced, vision-based tactile foot sensor that endows a bipedal robot with a skin-like deformable layer that captures contact deformations optically, turning foot-ground interactions into rich haptic signals. From a contact image stream, our method estimates contact pose (position and orientation), visualizes shear, computes center of pressure (CoP), classifies terrain, and detects geometric features of the contact patch. We validate these capabilities on a tilting platform and in visually obscured conditions, showing that foot-borne tactile feedback improves balance control and terrain awareness beyond proprioception alone. These findings suggest that integrating tactile perception into legged robot feet improves stability, adaptability, and environmental awareness, offering a promising direction toward more compliant and intelligent locomotion systems. For the supplementary video, please visit: https://youtu.be/ceJiy9q_2Aw

Problem

• tactile sensing
• bipedal robot
• legged locomotion
• contact perception
• terrain awareness

Innovation

• vision-based tactile sensing
• soft-surfaced sensor
• bipedal locomotion
• contact deformation
• terrain classification