Information-Theoretic Detection of Bimanual Interactions for Dual-Arm Robot Plan Generation
This work addresses the challenge of efficiently generating executable plans for dual-arm robotic tasks from human demonstrations, where bimanual coordination strategies are often complex and difficult to model. The authors propose a novel approach that leverages a single RGB video demonstration to synthesize structured, modular behavior tree plans. Their method uniquely integrates Shannon information theory to analyze information flow between hands, scene graph parsing to extract action semantics, and one-shot learning to enable generalization. By unifying these components within a behavior tree framework, the approach produces adaptable execution plans without requiring extensive training data. Evaluated on both a newly curated dataset and existing public benchmarks, the method demonstrates significant performance gains over current state-of-the-art techniques, marking a notable advance in centralized bimanual coordination planning.