T-800: An 800 Hz Data Glove for Precise Hand Gesture Tracking

📅 2026-03-27
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
Existing motion capture technologies struggle to simultaneously achieve high temporal resolution and robustness to occlusion, limiting their ability to accurately record rapid, contact-rich fine hand movements. To address this challenge, this work presents T-800, a high-bandwidth data glove integrating a broadcast synchronization mechanism, a mechanically stress-isolated architecture, and 18 distributed inertial measurement units (IMUs) to enable sub-frame temporal alignment during vigorous motion and synchronous full-hand dynamics capture at 800 Hz. The system reveals—for the first time—that human dexterous manipulation contains motion energy exceeding 100 Hz, surpassing the Nyquist limit of conventional systems. This breakthrough enables faithful reconstruction of previously unattainable high-frequency hand dynamics, which are then kinematically retargeted to a dexterous robotic hand to generate high-fidelity behavioral data for training robust control policies.
📝 Abstract
Human dexterity relies on rapid, sub-second motor adjustments, yet capturing these high-frequency dynamics remains an enduring challenge in biomechanics and robotics. Existing motion capture paradigms are compromised by a trade-off between temporal resolution and visual occlusion, failing to record the fine-grained hand motion of fast, contact-rich manipulation. Here we introduce T-800, a high-bandwidth data glove system that achieves synchronized, full-hand motion tracking at 800 Hz. By integrating a novel broadcast-based synchronization mechanism with a mechanical stress isolation architecture, our system maintains sub-frame temporal alignment across 18 distributed inertial measurement units (IMUs) during extended, vigorous movements. We demonstrate that T-800 recovers fine-grained manipulation details previously lost to temporal undersampling. Our analysis reveals that human dexterity exhibits significantly high-frequency motion energy (>100 Hz) that was fundamentally inaccessible due to the Nyquist sampling limit imposed by previous hardware constraints. To validate the system's utility for robotic manipulation, we implement a kinematic retargeting algorithm that maps T-800's high-fidelity human gestures onto dexterous robotic hand models. This demonstrates that the high-frequency motion data can be accurately translated while respecting the kinematic constraints of robotic hands, providing the rich behavioral data necessary for training robust control policies in the future.
Problem

Research questions and friction points this paper is trying to address.

hand gesture tracking
high-frequency motion
temporal resolution
visual occlusion
dexterous manipulation
Innovation

Methods, ideas, or system contributions that make the work stand out.

high-frequency motion capture
data glove
inertial measurement unit (IMU)
kinematic retargeting
temporal synchronization
🔎 Similar Papers
No similar papers found.
Haoyang Luo
Haoyang Luo
City University of Hong Kong, Hong Kong
Multimodal
Zihang Zhao
Zihang Zhao
PhD Candidate, Peking University
manipulationtactile robotics
Leiyao Cui
Leiyao Cui
University of Chinese Academy of Sciences
Computer VisionRobotics
S
Saiyao Zhang
State Key Laboratory of Robotics and Intelligent Systems, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China; University of Chinese Academy of Sciences, Beijing 100049, China; School of Psychological and Cognitive Sciences, Peking University, Beijing 100871, China (intern)
Liu Yang
Liu Yang
Tsinghua University
Management Science
Zhi Han
Zhi Han
SIA, CAS
Computer Vision
X
Xiyuan Tang
Institute for Artificial Intelligence, Peking University, Beijing 100871, China; School of Integrated Circuits, Peking University, Beijing 100871, China
Yixin Zhu
Yixin Zhu
Assistant Professor, Peking University
Computer VisionVisual ReasoningHuman-Robot Teaming