NavIsaacLab: Generating Realistic Crowd via Parallel Robot Learning for Benchmarking Human-aware Navigation

2026-06-24

AI Summary

Existing simulation platforms lack high-quality, diverse human crowd behavior data, hindering the training and evaluation of realistic and scalable human-aware navigation algorithms. To address this limitation, this work proposes an integrated simulation framework that combines physically grounded and photorealistic rendering with a trajectory diffusion model and an adversarial motion-learning controller to generate large-scale, physically plausible, and controllable crowd behaviors. Leveraging GPU-accelerated parallel simulation and multi-sensor signal synthesis, the platform delivers real-time 3D visual feedback for robotic agents. By unifying multi-scale environments with high-fidelity rendering for the first time, the framework substantially enhances the generalization and safety of navigation policies in complex dynamic settings, establishing the first high-fidelity benchmark for human-aware robot navigation.

Abstract

Robot autonomous navigation that accounts for surrounding human activities is crucial for ensuring both safety and natural human-robot interaction in real-world environments shared by humans and robots. Simulation of complex and diverse navigation scenarios serves as the foundation for training reliable robot navigation policies and accurately evaluating the performance of algorithms, offering an efficient alternative to manual supervision of real data. However, current human-aware navigation research faces significant challenges due to the scarcity of diverse, high-quality scene data. Existing simulation platforms often rely on handcrafted rules to approximate pedestrian behavior and lack the capability to provide extensive sensor signals, typically assuming perfect observations. To address these limitations, this paper presents NavIsaacLab, a comprehensive framework for benchmarking and training human-aware navigation policies through physics-based and photo-realistic simulations of pedestrians and scenes. Based on Isaac Lab, the proposed framework employs photo-realistic scene rendering capabilities and supports parallel simulation on GPU, delivering real-time and accurate 3D visual feedback to robots. To enhance the realism of human behavior, a data-driven approach is employed that incorporates a trajectory diffusion model and an adversarial motion learning controller, enabling controllable, physics-based pedestrian simulation. Furthermore, the integration of diverse cross-scale scenes provides a robust benchmark for state-of-the-art human-aware navigation methods.

Problem

• human-aware navigation
• simulation
• pedestrian behavior
• sensor signals
• realistic crowd

Innovation

• human-aware navigation
• physics-based simulation
• trajectory diffusion model
• parallel robot learning
• photo-realistic rendering