Solving Hamilton-Jacobi-Bellman equations by a modified method of characteristics
type: Item
instance of: scholarly article
title: Solving Hamilton-Jacobi-Bellman equations by a modified method of characteristics
zbMATH Open document ID: 0959.49021
DOI: 10.1016/S0362-546X(00)85016-6
published in: Nonlinear Analysis. Theory, Methods \& Applications. Series A: Theory and Methods
publication date: 2001-04-23T00:00:00Z
review text: Continuing previous work, the authors propose yet another numerical procedure for solving fixed time-interval optimal control problems (without end-point constraints) which consist in minimizing cost functionals of the form: \[ C(u(.))=h(x(1))+\int_{0}^{1}L(t,x(t),u(t)) dt \] subject to: \[ x'(t)=f(t,x(t),u(t)), \;u(t)\in U \subset R^m, \text{ a.e. }([0,1]), \;x(0)=y\in \Omega \subset R^n . \] Mentioning certain existing results in the theory of viscosity solutions in [\textit{M. Bardi} and \textit{I. Capuzzo-Dolcetta}, ``Optimal control and viscosity solutions of Hamilton-Jacobi-Bellman equations'' (1997; Zbl 0890.49011)], the authors propose a numerical procedure for solving the ``viscosity approximating equation'': \[ \varepsilon \nabla^2v-{{\partial v}\over {\partial t}}+H(t,x,-\nabla_x v)=0, \;v(1,x)=h(x), \;x\in \Omega,\leqno (1) \] defined by the Hamiltonian of the problem: \[ H(t,x,p) =\sup_{u\in U}{\mathcal H}(t,x,p,u), \;{\mathcal H}(t,x,p,u)=\langle p,f(t,x,u)\rangle- L(t,x,u), \] \[ u^*(t,x,p) = \text{argmax}_{u\in U} {\mathcal H}(t,x,p,u) \] and to which one adds certain ``artificial'' Dirichlet and Neumann boundary conditions. The numerical algorithm proposed by the authors uses an adaptation of the ``modified method of characteristics'' in [\textit{J. Douglas jun.} and \textit{T. F. Russell}, SIAM J. Numer. Anal. 19, 871-885 (1982; Zbl 0492.65051)] for the ``convection-diffusion'' equation in (1) in which the ``marginal multifunction'' \(u^*(.,.,.)\) seems to be considered a (single-valued) function. The largest part of the paper (some 8 pages out of 15) is dedicated to the reports (Tables and Figures) of numerical experiments on 5 examples.
Mathematics Subject Classification ID: 49M30
Mathematics Subject Classification ID: 49L20
Mathematics Subject Classification ID: 49L25
Mathematics Subject Classification ID: 65K10
zbMATH DE Number: 1472219
zbMATH Keywords: optimal control
zbMATH Keywords: Hamilton-Jacobi-Bellman equation
zbMATH Keywords: viscosity solution
zbMATH Keywords: viscosity approximation
zbMATH Keywords: convection-diffusion equation
zbMATH Keywords: numerical method
author: Chieh-Sen Huang
author: Song Wang
author: Kok Lay Teo
reviewed by: Ştefan Mirică
describes a project that uses: FFSQP(f77)
MaRDI profile type: Publication
cites work: Optimal control and viscosity solutions of Hamilton-Jacobi-Bellman equations
cites work: Viscosity Solutions of Hamilton-Jacobi Equations
cites work: Some Properties of Viscosity Solutions of Hamilton-Jacobi Equations
cites work: Q4866631
cites work: Q3808521
cites work: A time-discretization procedure for a mixed finite element approximation of miscible displacement in porous media
cites work: Numerical Methods for Convection-Dominated Diffusion Problems Based on Combining the Method of Characteristics with Finite Element or Finite Difference Procedures
cites work: On a new principle of superposition for optimization problems
cites work: Q4001347
cites work: An upwind finite-difference method for the approximation of viscosity solutions to Hamilton-Jacobi-Bellman equations
cites work: Verification theorems within the framework of viscosity solutions
Recommended article: NUMERICAL ANALYSIS OF A MINIMAX OPTIMAL CONTROL PROBLEM WITH AN ADDITIVE FINAL COST
Recommended article: Computations of Optimal Controls for Incompressible Flows
Recommended article: The viscosity approximation to the Hamilton-Jacobi-Bellman equation in optimal feedback control: upper bounds for extended domains
Recommended article: NUMERICAL APPROXIMATION OF VISCOSITY SOLUTIONS OF FIRST-ORDER HAMILTON-JACOBI EQUATIONS WITH NEUMANN TYPE BOUNDARY CONDITIONS
Recommended article: Approximation schemes for solving disturbed control problems with non-terminal time and state constraints
Recommended article: Numerical Solution of Boundary Control Problems for Boussinesq Model of Heat Convection
Recommended article: On application of an alternating direction method to Hamilton--Jacobin--Bellman equations.
Recommended article: Numerical Solution of Optimal Distributed Control Problems for Incompressible Flows
Recommended article: Approximation schemes for finding the value functions for differential games with nonterminal payoff functional
Recommended article: A survey of numerical methods for convection-diffusion optimal control problems
description: scientific article; zbMATH DE number 1472219