Optimal tracking control of nonlinear partially-unknown constrained-input systems using integral reinforcement learning

DOI10.1016/j.automatica.2014.05.011zbMath1296.93073OpenAlexW1968908471MaRDI QIDQ458982

Hamidreza Modares, Frank L. Lewis

Publication date: 8 October 2014

Published in: Automatica (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1016/j.automatica.2014.05.011

zbMATH Keywords

neural networksinput constrainersintegral reinforcement learningoptimal tracking control

Mathematics Subject Classification ID

Related Items (66)

Dynamic event-triggered distributed guaranteed cost FTC scheme for nonlinear interconnected systems via ADP approach ⋮ An integrated data-driven Markov parameters sequence identification and adaptive dynamic programming method to design fault-tolerant optimal tracking control for completely unknown model systems ⋮ General value iteration based single network approach for constrained optimal controller design of partially-unknown continuous-time nonlinear systems ⋮ Hierarchical optimal control for input-affine nonlinear systems through the formulation of Stackelberg game ⋮ A novel adaptive dynamic programming based on tracking error for nonlinear discrete-time systems ⋮ Fault-tolerant tracking control based on reinforcement learning with application to a steer-by-wire system ⋮ Composite learning from adaptive backstepping neural network control ⋮ Neural network robust tracking control with adaptive critic framework for uncertain nonlinear systems ⋮ A data-based neural policy learning strategy towards robust tracking control design for uncertain dynamic systems ⋮ Online barrier-actor-critic learning for \(H_\infty\) control with full-state constraints and input saturation ⋮ Simultaneous identification and optimal tracking control of unknown continuous-time systems with actuator constraints ⋮ Optimization of sampling intervals for tracking control of nonlinear systems: a game theoretic approach ⋮ Distributed optimized dynamic event-triggered control for unknown heterogeneous nonlinear MASs with input-constrained ⋮ Adaptive critic optimization to decentralized event‐triggered control of continuous‐time nonlinear interconnected systems ⋮ Reinforcement learning‐based optimized backstepping control of nonlinear strict feedback system with unknown control gain function ⋮ Off‐policy integral reinforcement learning‐based optimal tracking control for a class of nonzero‐sum game systems with unknown dynamics ⋮ Neural optimal tracking control of constrained nonaffine systems with a wastewater treatment application ⋮ Dynamic event-triggered controller design for nonlinear systems: reinforcement learning strategy ⋮ Adaptive dynamic programming‐based event‐triggered optimal tracking control ⋮ Online inverse reinforcement learning for nonlinear systems with adversarial attacks ⋮ Toward reliable designs of data-driven reinforcement learning tracking control for Euler-Lagrange systems ⋮ Event-triggered adaptive dynamic programming for decentralized tracking control of input constrained unknown nonlinear interconnected systems ⋮ Continuous‐time receding‐horizon reinforcement learning and its application to path‐tracking control of autonomous ground vehicles ⋮ Event‐driven adaptive near‐optimal tracking control of the robot in aircraft skin inspection ⋮ Integral reinforcement learning‐based approximate minimum time‐energy path planning in an unknown environment ⋮ Event‐triggered optimal tracking control of multiplayer unknown nonlinear systems via adaptive critic designs ⋮ Optimal game theoretic solution of the pursuit‐evasion intercept problem using on‐policy reinforcement learning ⋮ Optimal output tracking control of linear discrete-time systems with unknown dynamics by adaptive dynamic programming and output feedback ⋮ Dynamic event-triggered optimal tracking control for constrained nonlinear stochastic systems ⋮ Linear quadratic tracking control of unknown systems: a two-phase reinforcement learning method ⋮ Hierarchical critic learning optimal control for lower limb exoskeleton robots with prescribed constraints ⋮ Off-policy reinforcement learning for tracking control of discrete-time Markov jump linear systems with completely unknown dynamics ⋮ Model-based reinforcement learning for approximate optimal regulation ⋮ Robust tracking control with reinforcement learning for nonlinear‐constrained systems ⋮ Adaptive dynamic programming‐based adaptive‐gain sliding mode tracking control for fixed‐wing unmanned aerial vehicle with disturbances ⋮ Optimal trajectory tracking control for a class of nonlinear nonaffine systems via generalized N‐step value gradient learning ⋮ Optimized adaptive consensus tracking control for uncertain nonlinear multiagent systems using a new event-triggered communication mechanism ⋮ Model-free adaptive dynamic event-triggered robust control for unknown nonlinear systems using iterative neural dynamic programming ⋮ Distributed fault‐tolerant control for over‐actuated multi‐agent systems with uncertain perturbations using control allocation ⋮ Event‐triggered neural experience replay learning for nonzero‐sum tracking games of unknown continuous‐time nonlinear systems ⋮ Reinforcement learning‐based tracking control for a quadrotor unmanned aerial vehicle under external disturbances ⋮ Improved value iteration for nonlinear tracking control with accelerated learning ⋮ Integral sliding mode‐based event‐triggered nearly optimal tracking control for uncertain nonlinear systems ⋮ Event-triggered optimal tracking control of nonlinear systems ⋮ Output feedback tracking control of a class of continuous-time nonlinear systems via adaptive dynamic programming approach ⋮ Experience replay–based output feedback Q‐learning scheme for optimal output tracking control of discrete‐time linear systems ⋮ Data-based and secure switched cyber-physical systems ⋮ Unnamed Item ⋮ Modified value-function-approximation for synchronous policy iteration with single-critic configuration for nonlinear optimal control ⋮ Optimal distributed synchronization control for continuous-time heterogeneous multi-agent differential graphical games ⋮ Data-driven optimal tracking control of discrete-time multi-agent systems with two-stage policy iteration algorithm ⋮ Event-triggered single-network ADP method for constrained optimal tracking control of continuous-time non-linear systems ⋮ Tracking control optimization scheme for a class of partially unknown fuzzy systems by using integral reinforcement learning architecture ⋮ Observer-based distributed consensus for general nonlinear multi-agent systems with interval control inputs ⋮ Output regulation of unknown linear systems using average cost reinforcement learning ⋮ Output‐feedback H_∞ quadratic tracking control of linear systems using reinforcement learning ⋮ Model-free \(H_\infty\) tracking control for de-oiling hydrocyclone systems via off-policy reinforcement learning ⋮ Q-learning solution for optimal consensus control of discrete-time multiagent systems using reinforcement learning ⋮ Inverse reinforcement learning for multi-player noncooperative apprentice games ⋮ Adaptive output regulation for cyber-physical systems under time-delay attacks ⋮ Approximate-optimal control algorithm for constrained zero-sum differential games through event-triggering mechanism ⋮ Online optimal and adaptive integral tracking control for varying discrete‐time systems using reinforcement learning ⋮ Optimal control of a class of nonlinear stochastic systems ⋮ Mixed density methods for approximate dynamic programming ⋮ Adaptive dynamic programming in the Hamiltonian-driven framework ⋮ Adaptive optimal output tracking of continuous-time systems via output-feedback-based reinforcement learning

Cites Work

• Neural network approach to continuous-time direct adaptive optimal control for partially unknown nonlinear systems
• Computational adaptive optimal control for continuous-time linear systems with completely unknown dynamics
• Integral reinforcement learning and experience replay for adaptive optimal control of partially-unknown constrained-input continuous-time systems
• Reinforcement \(Q\)-learning for optimal tracking control of linear discrete-time systems with unknown dynamics
• Integral \(Q\)-learning and explorized policy iteration for adaptive optimal control of continuous-time linear systems
• Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem
• Adaptive optimal control for continuous-time linear systems based on policy iteration
• A novel actor-critic-identifier architecture for approximate optimal control of uncertain nonlinear systems
• Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach
• Optimal Adaptive Control and Differential Games by Reinforcement Learning Principles
• Approximate Dynamic Programming
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item

This page was built for publication: Optimal tracking control of nonlinear partially-unknown constrained-input systems using integral reinforcement learning