On Bellman's approach to optimal control theory
type: Item
instance of: scholarly article
title: On Bellman's approach to optimal control theory
zbMATH Open document ID: 0971.49016
DOI: 10.1007/BF02674205
author: M. F. Sukhinin
published in: Mathematical Notes
publication date: 2001-05-13T00:00:00Z
review text: According to the author, the aim of this note is to obtain a refinement of his own result in [Math. Notes 38, 658-660 (1985); translation from Mat. Zametki 38, No.2, 265-269 (1985; Zbl 0593.49025)] concerning a certain type of generalization of the Bellman's equation satisfied by the \textit{minimal-time function}: \[ T(y):=\displaystyle \inf_{x(.)}t_1(y;x(.)), \;\;y\in X, \;t_1= t_1(y;x(.))>0 \] subject to: \[ x'(t)\in P(x(t)) \text{ for a.e. } t\in [0,t_1], \;x(0)=y, \;x(t)\neq x_1 \;\forall \;t\in [0,t_1), \;x(t_1)=x_1 \] where \(x_1\in X\) is a given ``target point''. The author uses his own ``differential set of a function'' \(\phi (.):W\subset X \to R\) in a direction \(u\in X\), defined by: \[ DS_u\phi (x):=\bigcap_{\varepsilon >0}\text{Cl}[\bigcup_{\delta \in (0, \varepsilon)} \delta^{-1}[\phi ([x+\delta (u+\varepsilon B)]\cap W)-\phi (x)] \] which actually coincides with the better known ``set-valued contingent derivative'' in [\textit{J. P. Aubin} and \textit{H. Frankowska}, ``Set-valued analysis'' (1990; Zbl 0713.49021)]. The main result, expressed in terms of certain very abstract ``sets of admissible directions'' \(U(x)\subset P(x)\), \(x\in W:= \text{dom}(T(.))\), states that the minimal-time function satisfies the differential inequality: \[ \sup_{u\in U(x)}\sup DS_u(-T) (x)\leq 1 \;\forall \;x\in W:= \text{dom}(T(.)) \] which, at differentiability points of \(T(.)\), coincides with the usual Bellman's equation. Related results, proved in the slightly different context of ``extreme contingent directional derivatives'' and of some more explicitely defined ``sets of generalized tangent directions to admissible trajectories'', may be found in [\textit{Şt. Mirică}, An. Ştiinţ. Univ. Al. I. Cuza Iaşi, Mat. 38, No. 1, 89-102 (1992; Zbl 0823.49020)]; one may note also that the proofs may be simplified using the well-known fact that for any admissible trajectory, the real function \(t\mapsto T(x(t))+t\) is increasing on the interval \([0,t_1]\) and it is cons…
reviewed by: Ştefan Mirică
Mathematics Subject Classification ID: 49L20
Mathematics Subject Classification ID: 49J52
Mathematics Subject Classification ID: 49J53
Mathematics Subject Classification ID: 34A60
Mathematics Subject Classification ID: 49J24
zbMATH DE Number: 1517559
zbMATH Keywords: optimal control
zbMATH Keywords: differential inclusion
zbMATH Keywords: minimal-time function
zbMATH Keywords: Bellman's equation
zbMATH Keywords: differential set
zbMATH Keywords: admissible direction
MaRDI profile type: Publication
cites work: Viscosity Solutions of Hamilton-Jacobi Equations
cites work: DUALITY OF CONVEX FUNCTIONS AND EXTREMUM PROBLEMS
Recommended article: Q3196905
Recommended article: Q4869406
Recommended article: Q5186244
Recommended article: Uniqueness of Lower Semicontinuous Viscosity Solutions for the Minimum Time Problem
Recommended article: Q3797771
Recommended article: Q4362939
Recommended article: Q4731021
Recommended article: The dependence of the Bellman function on a parameter of the minimum time proplem for a Liénard equation with control
Recommended article: Derivation of locally optimal controls of weakly controllable systems from Bellman's equation
Recommended article: Continuous dynamic programming approach to inequalities. II
description: scientific article; zbMATH DE number 1517559