Problem
Research questions and friction points this paper is trying to address.
Force-aware Reinforcement Learning
Sensorless Force Estimation
Wheeled-legged Loco-manipulation
End-effector Interaction Forces
Force-Aware Reinforcement Learning with Hybrid Sensorless Force Estimation for Wheeled-Legged Loco-Manipulation
🤖 AI Summary
本文提出了一种结合混合无传感器力估计的力感知强化学习方法，以解决轮腿机器人在无末端执行器力/扭矩传感器情况下的力控操作问题。
📝 Abstract
Force-controlled loco-manipulation requires a whole-body policy to coordinate locomotion and arm motion while regulating end-effector interaction forces. This is challenging under floating-base dynamics and changing support contacts, particularly when end-effector force/torque sensing is unavailable for control. This paper presents a force-aware reinforcement learning approach with hybrid sensorless force estimation for wheeled-legged loco-manipulation. The proposed method provides a structured estimate of the end-effector force as an explicit policy observation, enabling force-guided contact behavior without using an end-effector force/torque sensor for control. The force estimate is obtained by combining generalized momentum observation, contact-constrained wrench projection, and temporal residual learning: the model-based components extract the physically structured part of the whole-body disturbance, while the residual network compensates the remaining motion-dependent bias. The estimated force is integrated into a mode-conditioned whole-body policy with an axis-wise force/position selector, allowing free-space motion, pure force regulation, and hybrid force/position control within one controller. Simulation results demonstrate improved sensorless force estimation and force-control performance. Hardware experiments further validate the proposed controller through quantitative valve-rotation and hybrid wiping evaluations, together with force-guided door opening and zero-force human-guided motion on a real wheeled-legged platform.
Innovation
Methods, ideas, or system contributions that make the work stand out.
force-aware reinforcement learning
hybrid sensorless force estimation
wheeled-legged loco-manipulation
whole-body policy
temporal residual learning
🔎 Similar Papers
No similar papers found.
