Generalized value iteration for discounted optimal control with stability analysis

DOI10.1016/J.SYSCONLE.2020.104847zbMath1454.93226OpenAlexW3111327451MaRDI QIDQ826853

Derong Liu, Ding Wang, Mingming Ha

Publication date: 6 January 2021

Published in: Systems \& Control Letters (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1016/j.sysconle.2020.104847

zbMATH Keywords

nonlinear systemsreinforcement learningadaptive dynamic programmingadmissible control policydiscounted optimal controlgeneralized value iteration

Mathematics Subject Classification ID

Nonlinear systems in control theory (93C10) Discrete-time control/observation systems (93C55) Asymptotic stability in control theory (93D20)

Related Items (8)

Novel optimal trajectory tracking for nonlinear affine systems with an advanced critic learning structure ⋮ Neural-network-based discounted optimal control via an integrated value iteration with accuracy guarantee ⋮ Modified general policy iteration based adaptive dynamic programming for unknown discrete‐time linear systems ⋮ Value‐iteration‐based affine nonlinear optimal control involving admissibility discussion ⋮ Discounted near‐optimal regulation of constrained nonlinear systems via generalized value iteration ⋮ A Lyapunov-based version of the value iteration algorithm formulated as a discrete-time switched affine system ⋮ Adaptive critic control with multi‐step policy evaluation for nonlinear zero‐sum games ⋮ Model-free optimal control of discrete-time systems with additive and multiplicative noises

Cites Work

• Unnamed Item
• Adaptive dynamic programming with applications in optimal control
• Distributed adaptive dynamic programming for data-driven optimal control
• Optimal control of unknown nonaffine nonlinear discrete-time systems based on adaptive dynamic programming
• Stability Analysis of Optimal Adaptive Control Using Value Iteration With Approximation Errors
• Reinforcement Learning and Feedback Control: Using Natural Decision Methods to Design Optimal Adaptive Controllers

This page was built for publication: Generalized value iteration for discounted optimal control with stability analysis