Dynamic Whole-Body Dancing with Humanoid Robots -- A Model-Based Control Approach

📅 2026-04-05
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
This study addresses the challenge of enabling humanoid robots to perform full-body dance motions that simultaneously exhibit dynamism, stability, and artistic expressiveness. The authors propose a model-based two-stage framework: in the offline phase, motion capture data retargeting combined with trajectory optimization yields dynamically feasible dance sequences; in the online phase, a centroidal dynamics-based model predictive control (MPC) scheme employs long-horizon prediction to adjust footstep placements in real time for robust disturbance rejection. The approach is validated through the first public demonstration of robust, synchronized, four-minute dynamic dancing performed by multiple full-sized Kuavo 4Pro humanoid robots, showcasing its effectiveness in dynamic execution, disturbance resilience, and artistic fidelity.
📝 Abstract
This paper presents an integrated model-based framework for generating and executing dynamic whole-body dance motions on humanoid robots. The framework operates in two stages: offline motion generation and online motion execution, both leveraging future state prediction to enable robust and dynamic dance motions in real-world environments. In the offline motion generation stage, human dance demonstrations are captured via a motion capture (MoCap) system, retargeted to the robot by solving a Quadratic Programming (QP) problem, and further refined using Trajectory Optimization (TO) to ensure dynamic feasibility. In the online motion execution stage, a centroidal dynamics-based Model Predictive Control (MPC) framework tracks the planned motions in real time and proactively adjusts swing foot placement to adapt to real world disturbances. We validate our framework on the full-size humanoid robot Kuavo 4Pro, demonstrating the dynamic dance motions both in simulation and in a four-minute live public performance with a team of four robots. Experimental results show that longer prediction horizons improve both motion expressiveness in planning and stability in execution.
Problem

Research questions and friction points this paper is trying to address.

humanoid robots
dynamic whole-body dancing
motion generation
motion execution
real-world stability
Innovation

Methods, ideas, or system contributions that make the work stand out.

Model Predictive Control
Trajectory Optimization
Humanoid Robotics
Whole-Body Motion
Dynamic Dance Generation
🔎 Similar Papers
S
Shibowen Zhang
Department of Automation, University of Science and Technology of China, Hefei 230027, China; State Key Laboratory of General Artificial Intelligence, Beijing Institute for General Artificial Intelligence (BIGAI), Beijing 100080, China
Jiayang Wu
Jiayang Wu
Jinan University
AI for science
Guannan Liu
Guannan Liu
Associate Professor, Beihang University
data miningbusiness intelligence
H
Helin Zhu
Department of Computer Science, Harbin Institute of Technology, Harbin 150001, China
Junjie Liu
Junjie Liu
Computer Science and Engineering Department, Washington University in St. Louis
Networking
Z
Zhehan Li
State Key Laboratory of General Artificial Intelligence, Beijing Institute for General Artificial Intelligence (BIGAI), Beijing 100080, China; School of Artificial Intelligence, Xidian University, Xi’an 710126, China
J
Junhong Guo
Department of Computer Science, Harbin Institute of Technology, Harbin 150001, China
X
Xiaokun Leng
Department of Computer Science, Harbin Institute of Technology, Harbin 150001, China
Hangxin Liu
Hangxin Liu
Beijing Institute for General Artificial Intelligence (BIGAI)
RoboticsLocalizationSensors
J
Jingwen Zhang
State Key Laboratory of General Artificial Intelligence, Beijing Institute for General Artificial Intelligence (BIGAI), Beijing 100080, China
Jikai Wang
Jikai Wang
University of Texas at Dallas
Computer VisionRoboticsMachine Learning
Zonghai Chen
Zonghai Chen
中国科学技术大学
控制科学与工程
Zhicheng He
Zhicheng He
Huawei Noah's Ark Lab
recommender systemnatural language processingnetwork embedding
Jiayi Wang
Jiayi Wang
Beijing Institute for General Artificial Intelligence (BIGAI)
Humanoid RobotsLocomotionLoco-ManipulationMPCMachine Learning
Yao Su
Yao Su
Worcester Polytechnic Institute
AIMachine LearningData Mining