Deprecated: $wgMWOAuthSharedUserIDs=false is deprecated, set $wgMWOAuthSharedUserIDs=true, $wgMWOAuthSharedUserSource='local' instead [Called from MediaWiki\HookContainer\HookContainer::run in /var/www/html/w/includes/HookContainer/HookContainer.php at line 135] in /var/www/html/w/includes/Debug/MWDebug.php on line 372
On the smoothness of solutions of linear-quadratic regulator for degenerate diffusions - MaRDI portal

Deprecated: Use of MediaWiki\Skin\SkinTemplate::injectLegacyMenusIntoPersonalTools was deprecated in Please make sure Skin option menus contains `user-menu` (and possibly `notifications`, `user-interface-preferences`, `user-page`) 1.46. [Called from MediaWiki\Skin\SkinTemplate::getPortletsTemplateData in /var/www/html/w/includes/Skin/SkinTemplate.php at line 691] in /var/www/html/w/includes/Debug/MWDebug.php on line 372

Deprecated: Use of QuickTemplate::(get/html/text/haveData) with parameter `personal_urls` was deprecated in MediaWiki Use content_navigation instead. [Called from MediaWiki\Skin\QuickTemplate::get in /var/www/html/w/includes/Skin/QuickTemplate.php at line 131] in /var/www/html/w/includes/Debug/MWDebug.php on line 372

On the smoothness of solutions of linear-quadratic regulator for degenerate diffusions (Q1780376)

From MaRDI portal





scientific article; zbMATH DE number 2174293
Language Label Description Also known as
English
On the smoothness of solutions of linear-quadratic regulator for degenerate diffusions
scientific article; zbMATH DE number 2174293

    Statements

    On the smoothness of solutions of linear-quadratic regulator for degenerate diffusions (English)
    0 references
    0 references
    7 June 2005
    0 references
    The author is concerned with the quadratic control problem to minimize the expected cost with discount factor \(\beta > 0\): \[ J(c)=E\left[\int_0^\infty e^{-\beta t}\{h(x_t) +| c_t| ^2\}\,dt\right] \] over \(c\in\mathcal A\) subject to the degenerate stochastic differential equation \[ dx_t = [Ax_t + c_t]\,dt + \sigma x_t\,dw_t,\quad x_0 = x\in\mathbb R,\quad t\geq 0, \] for non-zero constants \(A\), \(\sigma\neq 0\), and a continuous function \(h\) on \(\mathbb R\), where \(w_t\) is a one-dimensional standard Brownian motion on a complete probability space \((\Omega,\mathcal F, P)\) endowed with the natural filtration \(\mathcal F_t\) generated by \(\sigma(w_s, s\leq t)\), and \(\mathcal A\) denotes the class of all \(\mathcal F_t\)-progressively measurable processes \(c = (c_t)\) with \(J(c) < \infty\). It is assumed that \(h\) satisfies the following properties: \(h(x)\geq 0\) convex and there exists \(C>0\) such that \(h(x)\leq C(1 + | x| ^n)\), \(x\in\mathbb R\), \(n\geq2\). The purpose of this paper is to show the existence of a smooth solution \(u\) of the associated Hamilton-Jacobi-Bellman (in short, HJB) equation of the form: \[ -\beta u +\frac{1}{2}\sigma^2x^2u'' + Axu' + \min_{r\in\mathbb R}(r^2 + ru') + h(x) = 0\quad \text{in}\,\mathbb R,\tag{1} \] and to give a synthesis of optimal control. The author establishes the existence of a classical solution of the degenerate HJB equation (1) associated with this problem by the technique of viscosity solutions, and hence derives an optimal control from the optimality conditions in the HJB equation.
    0 references
    linear-quadratic regulator control problem
    0 references
    stochastic differential equation
    0 references
    Hamilton-Jacobi-Bellman equation
    0 references
    linear-quadratic problem
    0 references
    viscosity solutions
    0 references
    applications to control theory
    0 references

    Identifiers

    0 references
    0 references
    0 references
    0 references
    0 references