A nonlinear real time capable motion cueing algorithm based on deep reinforcement learning

2025-03-13

AI Summary

Six-degree-of-freedom (6-DOF) motion simulators face a fundamental trade-off among trajectory fidelity, hardware constraints, and real-time performance—especially within their nonlinear workspace. Method: This paper proposes a deep reinforcement learning (DRL)-based real-time motion cueing generation framework. It is the first to apply the Proximal Policy Optimization (PPO) algorithm under full dynamic modeling for motion cueing trajectory planning, explicitly encoding platform kinematic nonlinearity and hard physical constraints. Leveraging an Actor-Critic architecture with automated hyperparameter optimization, the method generates dynamically feasible trajectories within a sub-millisecond control cycle (<1 ms). Results: In full-system simulation, the approach matches or exceeds the performance of conventional washout filtering and nonlinear model predictive control (NMPC), effectively breaking the long-standing accuracy–efficiency trade-off. It establishes a novel paradigm for high-fidelity, real-time motion simulation.

Technology Category

• Search and Optimization: Sampling/Simulation-based Search
• Intelligent Robots: Motion and Path Planning
• Machine Learning: Imitation Learning & Inverse Reinforcement Learning

Application Category

• User Modeling, Personalization and Recommendation: User modeling and simulation for interactive and conversational systems
• Search and Retrieval-Augmented AI: Web learning to rank, online learning, and counterfactual learning for ranking
• Responsible Web: Machine-in-the-loop, human agency and autonomy

Abstract

In motion simulation, motion cueing algorithms are used for the trajectory planning of the motion simulator platform, where workspace limitations prevent direct reproduction of reference trajectories. Strategies such as motion washout, which return the platform to its center, are crucial in these settings. For serial robotic MSPs with highly nonlinear workspaces, it is essential to maximize the efficient utilization of the MSPs kinematic and dynamic capabilities. Traditional approaches, including classical washout filtering and linear model predictive control, fail to consider platform-specific, nonlinear properties, while nonlinear model predictive control, though comprehensive, imposes high computational demands that hinder real-time, pilot-in-the-loop application without further simplification. To overcome these limitations, we introduce a novel approach using deep reinforcement learning for motion cueing, demonstrated here for the first time in a 6-degree-of-freedom setting with full consideration of the MSPs kinematic nonlinearities. Previous work by the authors successfully demonstrated the application of DRL to a simplified 2-DOF setup, which did not consider kinematic or dynamic constraints. This approach has been extended to all 6 DOF by incorporating a complete kinematic model of the MSP into the algorithm, a crucial step for enabling its application on a real motion simulator. The training of the DRL-MCA is based on Proximal Policy Optimization in an actor-critic implementation combined with an automated hyperparameter optimization. After detailing the necessary training framework and the algorithm itself, we provide a comprehensive validation, demonstrating that the DRL MCA achieves competitive performance against established algorithms. Moreover, it generates feasible trajectories by respecting all system constraints and meets all real-time requirements with low...

Problem

• Overcome workspace limitations in motion simulation platforms.
• Address nonlinear properties in motion cueing algorithms.
• Enable real-time application with deep reinforcement learning.

Innovation

• Deep reinforcement learning for motion cueing
• 6-DOF kinematic model integration
• Proximal Policy Optimization training framework