FlyHaptics: Flying Multi-contact Haptic Interface

2025-05-05

AI Summary

This work addresses the lack of mid-air multi-point haptic feedback in immersive virtual reality (VR) and teleoperation. We propose a drone-based dynamic multi-contact haptic interface comprising six lightweight five-bar linkage mechanisms mounted within a protective cage, integrated with Vicon optical motion capture for high-precision pose estimation and stable hovering. By jointly optimizing vibration intensity modulation and flight stability control, the system enables real-time aerial rendering of predefined static haptic patterns. To our knowledge, this is the first demonstration of programmable, dynamic, multi-contact haptic feedback on an aerial platform—establishing a novel paradigm for wearable-free mid-air haptic interaction. Experimental evaluation shows an average user haptic pattern recognition accuracy of 86.5%, with no statistically significant difference across patterns. Furthermore, force output consistency and flight stability are validated under realistic operational conditions.

Technology Category

• Humans and AI: Interaction Techniques and Devices
• Intelligent Robots: Multimodal Perception & Sensor Fusion
• Computer Vision: Multi-modal Vision

Application Category

• Responsible Web: Machine-in-the-loop, human agency and autonomy
• Systems and Infrastructure for Web, Mobile and WoT: Web applications in cross-disciplinary domains and verticals such as mixed reality, smart cities, and digital health
• User Modeling, Personalization and Recommendation: User modeling and simulation for interactive and conversational systems

Abstract

This work presents FlyHaptics, an aerial haptic interface tracked via a Vicon optical motion capture system and built around six five-bar linkage assemblies enclosed in a lightweight protective cage. We predefined five static tactile patterns - each characterized by distinct combinations of linkage contact points and vibration intensities - and evaluated them in a grounded pilot study, where participants achieved 86.5 recognition accuracy (F(4, 35) = 1.47, p = 0.23) with no significant differences between patterns. Complementary flight demonstrations confirmed stable hover performance and consistent force output under realistic operating conditions. These pilot results validate the feasibility of drone-mounted, multi-contact haptic feedback and lay the groundwork for future integration into fully immersive VR, teleoperation, and remote interaction scenarios.

Problem

• Developing a drone-mounted multi-contact haptic interface for immersive feedback
• Evaluating tactile pattern recognition accuracy in aerial haptic interactions
• Ensuring stable hover and force output in real-world operating conditions

Innovation

• Aerial haptic interface with five-bar linkage assemblies
• Predefined tactile patterns with linkage contact points
• Drone-mounted multi-contact haptic feedback validation