Inverse Manipulation through Symbolic Planning and Residual Operator Learning
This work addresses the challenge of reversing robotic manipulation tasks, which cannot be reliably achieved through symbolic state inversion or trajectory replay alone due to the complexities of continuous dynamics that prevent symbolic inverse planning from accurately reproducing forward execution outcomes. To overcome this limitation, the authors propose a novel paradigm that integrates symbolic inverse planning with residual reinforcement learning. Specifically, soft geometric predicates are automatically extracted from demonstrations to construct STRIPS-style operators and define inverse goals. A task planner then invokes primitive actions to coarsely reverse the task, followed by fine-tuning via a Soft Actor-Critic algorithm that learns a residual policy to precisely satisfy any unmet symbolic predicates. Evaluated on the ManiSkill3 PushCube task, the approach successfully achieves full pose reversal of the cube while maintaining both symbolic logical consistency and physical feasibility.