Online solution of nonlinear two‐player zero‐sum games using synchronous policy iteration

DOI10.1002/rnc.1760zbMath1292.91011OpenAlexW2120038868MaRDI QIDQ5417563

Frank L. Lewis, Kyriakos G. Vamvoudakis

Publication date: 21 May 2014

Published in: International Journal of Robust and Nonlinear Control (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1002/rnc.1760

zbMATH Keywords

Nash equilibriumapproximate dynamic programmingHamilton-Jacobi-Isaacs equationsynchronous zero-sum game policy iteration

Mathematics Subject Classification ID

Dynamic programming in optimal control and differential games (49L20) Differential games and control (49N70) 2-person games (91A05)

Related Items

Multi-agent zero-sum differential graphical games for disturbance rejection in distributed control ⋮ Parametric Optimization in the Control Design for Nonlinear Differential Games with Zero Sum ⋮ A new iterative algorithm for solvingH_∞control problem of continuous-time Markovian jumping linear systems based on online implementation ⋮ Efficient path planning algorithms in reach-avoid problems ⋮ Robust adaptive dynamic programming for linear and nonlinear systems: an overview ⋮ Triggering and control co-design of nonlinear systems with external disturbances using adaptive dynamic programming ⋮ Online inverse reinforcement learning for nonlinear systems with adversarial attacks ⋮ Adaptive optimal control of continuous-time nonlinear affine systems via hybrid iteration ⋮ Model‐free incremental adaptive dynamic programming based approximate robust optimal regulation ⋮ Adaptive critic control with multi‐step policy evaluation for nonlinear zero‐sum games ⋮ Learning‐based collision avoidance and robust H_∞ optimal formation control for uncertain quadrotor UAV systems ⋮ An iterative computational scheme for solving the coupled Hamilton-Jacobi-Isaacs equations in nonzero-sum differential games of affine nonlinear systems ⋮ GPI-based design for partially unknown nonlinear two-player zero-sum games ⋮ Safe adaptive learning algorithm with neural network implementation for H∞ control of nonlinear safety‐critical system ⋮ Robust optimal control of the multi‐input systems with unknown disturbance based on adaptive integral reinforcement learning Q‐function ⋮ Modified value-function-approximation for synchronous policy iteration with single-critic configuration for nonlinear optimal control ⋮ Optimal consensus control for unknown second-order multi-agent systems: using model-free reinforcement learning method ⋮ Online approximate solution of HJI equation for unknown constrained-input nonlinear continuous-time systems ⋮ Online H∞ control for completely unknown nonlinear systems via an identifier–critic-based ADP structure ⋮ Online concurrent reinforcement learning algorithm to solve two‐player zero‐sum games for partially unknown nonlinear continuous‐time systems ⋮ An analytical fuzzy-based approach to -gain optimal control of input-affine nonlinear systems using Newton-type algorithm ⋮ Reinforcement learning and non-zero-sum game output regulation for multi-player linear uncertain systems ⋮ Output‐feedback H_∞ quadratic tracking control of linear systems using reinforcement learning ⋮ Model-FreeH_∞Control Design for Unknown Continuous-Time Linear System Using Adaptive Dynamic Programming ⋮ Q-learning solution for optimal consensus control of discrete-time multiagent systems using reinforcement learning ⋮ Robust optimal control for finite-horizon zero-sum differential games via a plug-n-play event-triggered scheme ⋮ Adaptive optimal tracking controls of unknown multi-input systems based on nonzero-sum game theory ⋮ Reinforcement learning for distributed control and multi-player games ⋮ A hybrid dynamical systems perspective on reinforcement learning for cyber-physical systems: vistas, open problems, and challenges

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem
• A game theoretic algorithm to compute local stabilizing solutions to HJBI equations in nonlinear \(H_\infty \) control
• Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach
• Adaptive Control Tutorial
• L/sub 2/-gain analysis of nonlinear systems and nonlinear state-feedback H/sub infinity / control
• Notes on uniform approximation of time-varying systems on finite time intervals
• Policy Iterations on the Hamilton–Jacobi–Isaacs Equation for $H_{\infty}$ State Feedback Control With Input Saturation
• The Method of Weighted Residuals and Variational Principles
• Optimal control and viscosity solutions of Hamilton-Jacobi-Bellman equations