Galerkin approximations of the generalized Hamilton-Jacobi-Bellman equation

DOI10.1016/S0005-1098(97)00128-3zbMath0949.93022OpenAlexW2047090868MaRDI QIDQ1388109

Randal W. Beard, George N. Saridis, John Ting-Yung Wen

Publication date: 8 June 1998

Published in: Automatica (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1016/s0005-1098(97)00128-3

zbMATH Keywords

feedback linearization Galerkin approximation Hamilton-Jacobi-Bellman LQR design method

Mathematics Subject Classification ID

Lua error in Module:PublicationMSCList at line 37: attempt to index local 'msc_result' (a nil value).

Related Items (86)

Asymptotic stabilization of nonlinear systems with convex-polytope input constraints by continuous input ⋮ Neural network approach to continuous-time direct adaptive optimal control for partially unknown nonlinear systems ⋮ Value iteration and adaptive dynamic programming for data-driven adaptive optimal control design ⋮ Approximate guaranteed cost fault-tolerant control of unknown nonlinear systems with time-varying actuator faults ⋮ Adaptive Optimal Control Without Weight Transport ⋮ Approximation design of optimal controllers for nonlinear systems with sinusoidal disturbances ⋮ Optimal control of unknown nonaffine nonlinear discrete-time systems based on adaptive dynamic programming ⋮ Observer-based fault detection for uncertain nonlinear systems ⋮ Robust nonlinear \(H^{\infty}\) control design via stable manifold method ⋮ Reinforcement learning solution for HJB equation arising in constrained optimal control problem ⋮ Online adaptive algorithm for optimal control with integral reinforcement learning ⋮ Policy iterations for reinforcement learning problems in continuous time and space -- fundamental theory and methods ⋮ Novel iterative neural dynamic programming for data-based approximate optimal control design ⋮ Self-learning robust optimal control for continuous-time nonlinear systems with mismatched disturbances ⋮ Model-free \(H_{\infty }\) control design for unknown linear discrete-time systems via Q-learning with LMI ⋮ Derivatives pricing with market impact and limit order book ⋮ Approximately adaptive neural cooperative control for nonlinear multiagent systems with performance guarantee ⋮ Robust min-max optimal control design for systems with uncertain models: a neural dynamic programming approach ⋮ On the Cahn-Hilliard equation with no-flux and strong anchoring conditions ⋮ Value-Gradient Based Formulation of Optimal Control Problem and Machine Learning Algorithm ⋮ Adaptive dynamic programming for decentralized neuro‐control of nonlinear systems subject to mismatched interconnections ⋮ A New Integral Critic Learning for Optimal Tracking Control with Applications to Boiler‐Turbine Systems ⋮ Dynamic event-triggered controller design for nonlinear systems: reinforcement learning strategy ⋮ Optimal polynomial feedback laws for finite horizon control problems ⋮ Event‐driven adaptive near‐optimal tracking control of the robot in aircraft skin inspection ⋮ A transformation approach for solving the Hamilton-Jacobi-Bellman equation in \({\mathcal H}_2\) deterministic and stochastic optimal control of affine nonlinear systems. ⋮ Optimal output tracking control of linear discrete-time systems with unknown dynamics by adaptive dynamic programming and output feedback ⋮ An iterative computational scheme for solving the coupled Hamilton-Jacobi-Isaacs equations in nonzero-sum differential games of affine nonlinear systems ⋮ Observer‐based event triggered ADP approach for input‐constrained nonlinear systems with disturbances ⋮ Data-driven optimal control via linear transfer operators: a convex approach ⋮ Robust adaptive critic control design with network-based event-triggered formulation ⋮ Convex quadratic equation ⋮ Off-policy based adaptive dynamic programming method for nonzero-sum games on discrete-time system ⋮ Reinforcement learning‐based optimal trajectory tracking control of surface vessels under input saturations ⋮ Adaptive optimal formation control for unmanned surface vehicles with guaranteed performance using actor‐critic learning architecture ⋮ Optimized adaptive consensus tracking control for uncertain nonlinear multiagent systems using a new event-triggered communication mechanism ⋮ Passivity‐based control design frameworks for hybrid nonlinear time‐varying dynamical systems ⋮ Approximate solutions to the Hamilton-Jacobi equations for generating functions ⋮ Output feedback tracking control of a class of continuous-time nonlinear systems via adaptive dynamic programming approach ⋮ Polynomial Approximation of High-Dimensional Hamilton--Jacobi--Bellman Equations and Applications to Feedback Control of Semilinear Parabolic PDEs ⋮ Unnamed Item ⋮ Adaptive dynamic programming and optimal control of nonlinear nonaffine systems ⋮ Distributed adaptive dynamic programming for data-driven optimal control ⋮ Two-phase selective decentralization to improve reinforcement learning systems with MDP ⋮ Optimal tracking control for large-scale interconnected systems with time-delays ⋮ Modified value-function-approximation for synchronous policy iteration with single-critic configuration for nonlinear optimal control ⋮ Stochastic optimal control via forward and backward stochastic differential equations and importance sampling ⋮ Galerkin Method and Weighting Functions Applied to Nonlinear H∞ Control with Output Feedback ⋮ On the infinite time solution to state-constrained stochastic optimal control problems ⋮ Feedback control methodologies for nonlinear systems ⋮ Numerical solutions to the Bellman equation of optimal control ⋮ Online concurrent reinforcement learning algorithm to solve two‐player zero‐sum games for partially unknown nonlinear continuous‐time systems ⋮ Solutions of nonlinear optimal and robust control problems via a mixed collocation/DAE's based algorithm ⋮ Feedback control method using Haar wavelet operational matrices for solving optimal control problems ⋮ Successive approximation approach of optimal control for nonlinear discrete-time systems ⋮ Variable structure disturbance rejection control for nonlinear uncertain systems with state and control delays via optimal sliding mode surface approach ⋮ Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem ⋮ On infinite-time nonlinear quadratic optimal control ⋮ Stochastic differential games: a sampling approach via FBSDEs ⋮ Iterative computational approach to the solution of the Hamilton-Jacobi-Bellman-Isaacs equation in nonlinear optimal control ⋮ A neural network-based policy iteration algorithm with global \(H^2\)-superlinear convergence for stochastic games on domains ⋮ On the convergence of successive Galerkin approximation for nonlinear output feedback \(H_{\infty}\) control ⋮ Some numerical tests for an alternative approach to optimal feedback control ⋮ Decentralized adaptive optimal stabilization of nonlinear systems with matched interconnections ⋮ Optimal control for nonlinear continuous systems by adaptive dynamic programming based on fuzzy basis functions ⋮ Successive approximation procedure of optimal tracking control for nonlinear similar composite systems ⋮ Multi-step heuristic dynamic programming for optimal control of nonlinear discrete-time systems ⋮ Approximate solutions to the time-invariant Hamilton-Jacobi-Bellman equation ⋮ Nonlinear optimal approach to spacecraft formation flying using Lorentz and impulsive actuation ⋮ Feedback controller design for linear and a class of nonlinear optimal control problems ⋮ A new analytical method for solving a class of nonlinear optimal control problems ⋮ Observer-based approximate optimal tracking control for time-delay systems with external disturbances ⋮ Guaranteed cost spacecraft attitude stabilization under actuator misalignments using linear partial differential equations ⋮ Stabilization of a class of nonlinear control systems via a neural network scheme with convergence analysis ⋮ Tensor Decomposition Methods for High-dimensional Hamilton--Jacobi--Bellman Equations ⋮ Computationally efficient simultaneous policy update algorithm for nonlinearH_∞state feedback control with Galerkin's method ⋮ Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach ⋮ Nonlinear optimal control as quantum mechanical eigenvalue problems ⋮ A numerical approach to hybrid nonlinear optimal control ⋮ Data-based approximate policy iteration for affine nonlinear continuous-time optimal control design ⋮ Approximate optimal trajectory tracking for continuous-time nonlinear systems ⋮ When does stabilizability imply the existence of infinite horizon optimal control in nonlinear systems? ⋮ Actor-Critic Method for High Dimensional Static Hamilton--Jacobi--Bellman Partial Differential Equations based on Neural Networks ⋮ Reinforcement learning for adaptive optimal control of unknown continuous-time nonlinear systems with input constraints ⋮ An improved iterative computational approach to the solution of the Hamilton–Jacobi equation in optimal control problems of affine nonlinear systems with application ⋮ Robust stabilization of non-linear systems by discontinuous dynamic state feedback

Cites Work

This page was built for publication: Galerkin approximations of the generalized Hamilton-Jacobi-Bellman equation