Stability of infinite-horizon optimal control with discounted cost

Romain Postoyan (1) , Lucian Busoniu (2) , Dragan Nesic (3) , Jamal Daafouz (4, 1)

1 CRAN - Centre de Recherche en Automatique de Nancy
2 UTCN - Universitatea Tehnica din Cluj-Napoca
3 Department of Electrical and Electronic Engineering [Melbourne]
4 IUF - Institut universitaire de France

We investigate the stability of general nonlinear discrete-time systems controlled by an optimal sequence of inputs that minimizes an infinite-horizon discounted cost. We first provide conditions under which a global asymptotic stability property is ensured for the corresponding undiscounted problem. We then show that this property is semiglobally and practically preserved in the discounted case, where the adjustable parameter is the discount factor. We then focus on a scenario where the stage cost is bounded and we explain how our framework applies to guarantee stability in this case. Finally, we provide sufficient conditions, including boundedness of the stage cost, under which the value function, which serves as a Lyapunov function for the analysis, is continuous. As already shown in the literature, the continuity of the Lyapunov function is crucial to ensure some nominal robustness for the closed-loop system.

Mots clés: Optimal control; Nonlinear systems; Discrete-time systems; Discounted cost

Domaines: Automatique / Robotique

Romain Postoyan, Lucian Busoniu, Dragan Nesic, Jamal Daafouz. Stability of infinite-horizon optimal control with discounted cost. 53rd IEEE Conference on Decision and Control, Dec 2014, Los Angeles, United States. ⟨hal-01080084⟩