betaFeedback

WorksEngineering

Exploration as Feedback in Model Predictive Path Integral Control

Abstract

This paper investigates how exploration affects closed-loop stability in model predictive path integral (MPPI) control. With a warm start, MPPI optimizes a control sequence by sampling candidates around the previous solution, and their covariance, the exploration covariance, is typically tuned to balance solution quality and computational cost. Small exploration is attractive because most samples then contribute to the solution, and existing stability analyses treat reduced exploration only as a bias toward the previous solution. Whether insufficient exploration can destabilize the closed loop has therefore remained open. We show that, for linear quadratic (LQ) problems with infinitely many samples, the exploration covariance also determines the feedback gain, i.e., how strongly MPPI updates the previous solution in response to the current state. With small exploration at a fixed temperature, MPPI nearly repeats the previous solution and fails to stabilize an exponentially unstable plant. Because a single covariance governs both exploration and feedback, stability and sample efficiency are in structural conflict: stabilization requires large exploration, which leaves few samples that contribute to the solution. To resolve this conflict, we propose Stabilizing Subspace MPPI (SS-MPPI), which computes the control inputs required for stabilization and samples only the rest. For LQ problems, SS-MPPI remains stable with small exploration and is thus sample-efficient. Simulations of an inverted pendulum and a quadruped robot confirm the analysis, showing that MPPI fails under small exploration, whereas SS-MPPI remains stable even with few samples.

Paper details

vlnc:W_b9tcr2ut
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
arXiv nonexclusive license
Usage

views · 0

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Engineering

Anthropic’s Claude

View statement
Looking for related papers…