Smooth Model Predictive Path Integral Control Without Smoothing

📅 2021-12-18
🏛️ IEEE Robotics and Automation Letters
📈 Citations: 45
Influential: 2
📄 PDF
🤖 AI Summary
To address control chattering and divergence of sampling-based Model Predictive Path Integral (MPPI) control in nonlinear systems—particularly under dynamic conditions due to stochastic sampling—this paper proposes an intrinsically smooth MPPI framework. Methodologically, it introduces: (1) an input-lifting strategy that embeds control inputs into a high-dimensional differentiable manifold to enhance action-space continuity; and (2) an information-theoretic action cost function that implicitly enforces temporal smoothness of the control sequence without external filtering or post-processing. The formulation rigorously preserves MPPI’s information-theoretic foundation and compatibility with non-affine dynamics. Evaluated on swing-up of an inverted pendulum and neural-network-modeled autonomous driving, the method significantly suppresses chattering and improves closed-loop stability and convergence robustness compared to baseline MPPI augmented with moving-average smoothing.
📝 Abstract
We present a sampling-based control approach that can generate smooth actions for general nonlinear systems without external smoothing algorithms. Model Predictive Path Integral (MPPI) control has been utilized in numerous robotic applications due to its appealing characteristics to solve non-convex optimization problems. However, the stochastic nature of sampling-based methods can cause significant chattering in the resulting commands. Chattering becomes more prominent in cases where the environment changes rapidly, possibly even causing the MPPI to diverge. To address this issue, we propose a method that seamlessly combines MPPI with an input-lifting strategy. In addition, we introduce a new action cost to smooth control sequence during trajectory rollouts while preserving the information theoretic interpretation of MPPI, which was derived from non-affine dynamics. We validate our method in two nonlinear control tasks with neural network dynamics: a pendulum swing-up task and a challenging autonomous driving task. The experimental results demonstrate that our method outperforms the MPPI baselines with additionally applied smoothing algorithms.
Problem

Research questions and friction points this paper is trying to address.

Eliminates chattering in sampling-based control commands
Generates smooth actions without external smoothing algorithms
Maintains information theoretic interpretation while smoothing controls
Innovation

Methods, ideas, or system contributions that make the work stand out.

Sampling-based control with input-lifting strategy
New action cost for smooth control sequences
Preserves information theoretic interpretation of MPPI
🔎 Similar Papers
No similar papers found.
T
Taekyung Kim
Ground Technology Research Institute, Agency for Defense Development, Daejeon 34186, Republic of Korea
G
Gyuhyun Park
Department of Mechanical Engineering, Seoul National University, Seoul 08826, Republic of Korea and also with the Ground Technology Research Institute, Agency for Defense Development, Daejeon 34186, Republic of Korea
K
K. Kwak
Ground Technology Research Institute, Agency for Defense Development, Daejeon 34186, Republic of Korea
J
Jihwan Bae
Ground Technology Research Institute, Agency for Defense Development, Daejeon 34186, Republic of Korea
Wonsuk Lee
Wonsuk Lee
Agency for Defense Development
AutonomyRoboticsLearningControl