Biomechanically consistent real-time action recognition for human-robot interaction
This work addresses the challenge of real-time, biomechanically plausible human action recognition in industrial settings using standard 2D cameras. We propose an end-to-end framework that takes joint angles—not joint coordinates—as input, integrating human kinematic modeling and biomechanical priors into a lightweight Transformer architecture equipped with a temporal smoothing mechanism. This design significantly enhances robustness against pose variations, inter-subject anatomical differences, and camera viewpoint shifts, enabling truly low-latency online interaction. Evaluated on a custom industrial action dataset comprising 11 subjects, our method achieves 88% classification accuracy, outperforming mainstream real-time baselines. Furthermore, it successfully enables real-time closed-loop control of a simulated robot, demonstrating practical applicability in industrial automation scenarios.