🤖 AI Summary
This study addresses the challenges of grasping difficulty and poor generalization in flat object manipulation by proposing a unified framework that decouples policy generation from execution. Leveraging contrastive learning, the method predicts policies and dynamically composes action primitives to enable adaptive manipulation in complex scenarios. Furthermore, this work introduces FlatLab, the first high-fidelity simulation benchmark for flat object manipulation, providing a standardized evaluation protocol. Experimental results demonstrate that the proposed framework achieves stable manipulation and effective generalization on unseen object categories, significantly outperforming existing baselines. Collectively, these contributions establish a novel paradigm and a reliable validation platform for advancing research in flat object manipulation.
📝 Abstract
Robotic manipulation of flat objects is challenging due to the ungraspable configurations and strong variations in object geometry and material. Existing methods rely on heuristic pre-manipulation and are often evaluated in closed settings with limited generalization. We propose a unified framework that decouples the manipulation into a strategy generator and an action execution module. The strategy generator predicts appropriate manipulation strategies from object point clouds by learning strategy-centric, object-invariant representations via simulated data transformation and contrastive learning. Conditioned on the predicted strategy, the execution module decomposes long-horizon manipulation into reusable action primitives and dynamically composes them to generate stable trajectories. To enable systematic evaluation, we introduce FlatLab, a comprehensive simulation benchmark for robotic flat object manipulation. FlatLab provides high-fidelity physical simulation of diverse rigid and deformable flat objects, automated multi-modal data collection, and standardized task definitions and evaluation protocols. Experiments conducted in FlatLab demonstrate that our approach generalizes effectively to unseen objects and categories, outperforming existing baselines. The project page and the code are provided at https://flatlab-web.github.io/.