Humanoid Locomotion and Manipulation: Current Progress and Challenges in Control, Planning, and Learning

📅 2025-01-03
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
This paper systematically reviews the state of locomotion control, dexterous manipulation, and cognitive coordination in humanoid robots, identifying three core challenges: insufficient multimodal fusion, poor generalization across tasks and environments, and unsafe human–robot physical interaction. To address these, the work unifies— for the first time—three decades of model-driven approaches (e.g., model predictive control, motion planning) with emerging learning paradigms (e.g., reinforcement learning, imitation learning), analyzing their integration pathways. It further proposes two forward-looking research directions: embodied foundation models and whole-body tactile sensing. The study constructs a comprehensive evolutionary map of humanoid loco-manipulation capabilities, pinpoints critical breakthrough areas—including multimodal sensorimotor coordination, cross-task generalization, and provably safe interaction—and establishes a theoretical framework and technical roadmap toward general embodied intelligence in humanoid robotics.

Technology Category

Application Category

📝 Abstract
Humanoid robots have great potential to perform various human-level skills. These skills involve locomotion, manipulation, and cognitive capabilities. Driven by advances in machine learning and the strength of existing model-based approaches, these capabilities have progressed rapidly, but often separately. Therefore, a timely overview of current progress and future trends in this fast-evolving field is essential. This survey first summarizes the model-based planning and control that have been the backbone of humanoid robotics for the past three decades. We then explore emerging learning-based methods, with a focus on reinforcement learning and imitation learning that enhance the versatility of loco-manipulation skills. We examine the potential of integrating foundation models with humanoid embodiments, assessing the prospects for developing generalist humanoid agents. In addition, this survey covers emerging research for whole-body tactile sensing that unlocks new humanoid skills that involve physical interactions. The survey concludes with a discussion of the challenges and future trends.
Problem

Research questions and friction points this paper is trying to address.

Humanoid Robotics
Current Challenges
Future Directions
Innovation

Methods, ideas, or system contributions that make the work stand out.

Machine Learning Enhanced Robotics
Full-Body Perception
Adaptability in Human Environment
🔎 Similar Papers
No similar papers found.
Zhaoyuan Gu
Zhaoyuan Gu
Georgia Tech
Humanoid RoboticsArtificial Intelligence
J
Junheng Li
The University of Southern California
Wenlan Shen
Wenlan Shen
Technical University of Munich
RoboticsHumanoid Robotics
W
Wenhao Yu
Google DeepMind
Zhaoming Xie
Zhaoming Xie
Research Scientist at the AI Institute
Character AnimationControlRoboticsMachine Learning
Stephen McCrory
Stephen McCrory
Institute for Human and Machine Cognition, University of West Florida
RoboticsMotion PlanningControlsUser Interfaces
Xianyi Cheng
Xianyi Cheng
Duke University
RoboticsRobotic ManipulationDexterous Manipulation
Abdulaziz Shamsah
Abdulaziz Shamsah
Kuwait University
LocomotionRoboticsSafety
Robert Griffin
Robert Griffin
IHMC
RoboticsHumanoidsExoskeletons
C. Karen Liu
C. Karen Liu
Professor of Computer Science, Stanford University
Computer GraphicsRobotics.
Abderrahmane Kheddar
Abderrahmane Kheddar
Centre National de la Recherche Scientifique (CNRS)
HapticsHumanoid robotsMind controlled humanoids and embodiment
X
Xue Bin Peng
Simon Fraser University
Yuke Zhu
Yuke Zhu
The University of Texas at Austin, NVIDIA Research
Robot LearningComputer VisionMachine LearningRoboticsArtificial Intelligence
Guanya Shi
Guanya Shi
Assistant Professor, CMU RI | Amazon Scholar, FAR (Frontier AI & Robotics)
RoboticsRobot LearningReinforcement LearningControlHumanoid
Q
Quan Nguyen
The University of Southern California
Gordon Cheng
Gordon Cheng
Technical University of Munich
NeuroRoboticsNeuroEngineeringImitation LearningCognitive SystemsHumanoid Robotics
H
Huijun Gao
Harbin Institute of Technology
Y
Ye Zhao
Georgia Institute of Technology