A homing problem for diffusion processes with control-dependent variance. (Q1879890)
From MaRDI portal
scientific article
| Language | Label | Description | Also known as |
|---|---|---|---|
| English | A homing problem for diffusion processes with control-dependent variance. |
scientific article |
Statements
A homing problem for diffusion processes with control-dependent variance. (English)
0 references
15 September 2004
0 references
This paper deals with optimal control problems of 1-dimensional diffusion processes defined by the stochastic differential equation \[ dX(t)= f(X(t))\,dt+ (v(X(t))| u(t)|)^{{1\over 2}} dW(t), \] with initial \(X(0)= x\in[d_1, d_2]\), where \(u\) is a control process and \(W\) a standard Brownian motion. So, \(X\) has a control-dependent infinitesimal variance. The aim is to minimize the cost criterion \[ J(x)= \int^{\tau(x)}_0 (\textstyle{{1\over 2}} q(X(t)) u^2(t)+ \lambda)\,dt+ K(X(\tau(x))), \] where \(\tau(x)\) is the hitting time to the boundary points, \(d_1\), \(d_2\), and \(\lambda\) a real constant. Using the dynamic programming equation, the author investigates the value function and optimal control. In particular, he obtains explicit expressions for the value function and the optimal control when the functions \(f\), \(v\) and \(q\) are proportional to a power of \(x\).
0 references
dynamic programming equation
0 references
stochastic differential equation
0 references
hitting place
0 references
Brownian motion
0 references
diffusion processes
0 references
control-dependent variance
0 references
hitting time
0 references
value function
0 references
optimal control
0 references