🤖 AI Summary
Existing motion capture technologies struggle to simultaneously achieve high temporal resolution and robustness to occlusion, limiting their ability to accurately record rapid, contact-rich fine hand movements. To address this challenge, this work presents T-800, a high-bandwidth data glove integrating a broadcast synchronization mechanism, a mechanically stress-isolated architecture, and 18 distributed inertial measurement units (IMUs) to enable sub-frame temporal alignment during vigorous motion and synchronous full-hand dynamics capture at 800 Hz. The system reveals—for the first time—that human dexterous manipulation contains motion energy exceeding 100 Hz, surpassing the Nyquist limit of conventional systems. This breakthrough enables faithful reconstruction of previously unattainable high-frequency hand dynamics, which are then kinematically retargeted to a dexterous robotic hand to generate high-fidelity behavioral data for training robust control policies.
📝 Abstract
Human dexterity relies on rapid, sub-second motor adjustments, yet capturing these high-frequency dynamics remains an enduring challenge in biomechanics and robotics. Existing motion capture paradigms are compromised by a trade-off between temporal resolution and visual occlusion, failing to record the fine-grained hand motion of fast, contact-rich manipulation. Here we introduce T-800, a high-bandwidth data glove system that achieves synchronized, full-hand motion tracking at 800 Hz. By integrating a novel broadcast-based synchronization mechanism with a mechanical stress isolation architecture, our system maintains sub-frame temporal alignment across 18 distributed inertial measurement units (IMUs) during extended, vigorous movements. We demonstrate that T-800 recovers fine-grained manipulation details previously lost to temporal undersampling. Our analysis reveals that human dexterity exhibits significantly high-frequency motion energy (>100 Hz) that was fundamentally inaccessible due to the Nyquist sampling limit imposed by previous hardware constraints. To validate the system's utility for robotic manipulation, we implement a kinematic retargeting algorithm that maps T-800's high-fidelity human gestures onto dexterous robotic hand models. This demonstrates that the high-frequency motion data can be accurately translated while respecting the kinematic constraints of robotic hands, providing the rich behavioral data necessary for training robust control policies in the future.