🤖 AI Summary
This work addresses the challenge of tightly coupling high-fidelity physical simulation with photorealistic real-time rendering in contact-rich robotic systems, particularly in modeling deformation and tactile perception. The authors present the first deep integration of GPU-accelerated Incremental Potential Contact (IPC) into the IsaacSim/Isaac Lab platform and introduce the Geometric Mortar Contact Potential (GMCP) to more accurately capture contact pressure distributions on tactile surfaces. By establishing a deformation mapping mechanism between simulation and visual meshes, the approach enables synchronized physics simulation and rendering in scenarios involving rigid–soft interactions. Experiments demonstrate the method’s effectiveness across multiple contact benchmarks and its successful application to high-fidelity, real-time simulation and data generation for quadrupedal robots, dexterous hands, and UMI grippers.
📝 Abstract
We present IsaacIPC, a robotic simulation framework that couples GPU accelerated incremental potential contact (IPC) with IsaacSim/Lab. IsaacIPC maps simulated deformation between simulation and visual meshes, enabling real-time realistic rendering with applications to data collection and policy evaluation. For tactile sensing, we introduce the geometric mortar contact potential (GMCP), which defines a barrier potential over contact samples on tactile surfaces to better resolve contact-pressure distributions. We evaluate GMCP on contact benchmarks and demonstrate IsaacIPC on rigid-deformable robotic simulations including a quadruped robot, a dexterous hand, and a universal manipulation interface (UMI) gripper.