Time discretisation and rate of convergence for the optimal control of continuous-time stochastic systems with delay

DOI10.1007/s00245-007-9019-4zbMath1211.65077OpenAlexW2161226558MaRDI QIDQ946221

Giovanna Nappo, Markus Fischer

Publication date: 22 September 2008

Published in: Applied Mathematics and Optimization (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1007/s00245-007-9019-4

zbMATH Keywords

stochastic differential equationconvergencedelaystochastic optimal controlerror boundfinite differencesfunctional differential equationtime lagtime discretisationsemi-discretisation

Mathematics Subject Classification ID

Numerical optimization and variational techniques (65K10) Optimal stochastic control (93E20) Stochastic calculus of variations and the Malliavin calculus (60H07) Computational methods for stochastic equations (aspects of stochastic analysis) (60H35) Numerical solutions to stochastic differential and integral equations (65C30) Existence of optimal solutions to problems involving randomness (49J55)

Related Items

Discrete Approximations of Controlled Stochastic Systems with Memory: A Survey ⋮ A stochastic control problem with delay arising in a pension fund model ⋮ Recurrent neural networks for stochastic control problems with delay ⋮ Finite-dimensional representations for controlled diffusions with delay

Cites Work

• Stochastic control problems with delay
• Discretisation of stochastic control problems for continuous time dynamics with delay
• Approximating value functions for controlled degenerate diffusion processes by using piece-wise constant policies.
• Discrete time high-order schemes for viscosity solutions of Hamilton- Jacobi-Bellman equations
• On the rate of convergence of finite-difference approximations for Bellman's equations with variable coefficients
• Moderate deviations for diffusions with Brownian potentials
• Introduction to the numerical analysis of stochastic delay differential equations
• Mean value theorems for stochastic integrals
• Euler's approximations of solutions of SDEs with reflecting boundary.
• Some Solvable Stochastic Control Problems With Delay
• Pathwise Stochastic Optimal Control
• Convergence in Nonlinear Filtering for Stochastic Delay Systems
• Error bounds for monotone approximation schemes for parabolic Hamilton-Jacobi-Bellman equations
• SOME NEW RESULTS IN THE THEORY OF CONTROLLED DIFFUSION PROCESSES
• Dynamic programming in stochastic control of systems with delay
• When Are HJB-Equations in Stochastic Control of Delay Systems Finite Dimensional?
• Numerical Solutions of Stochastic Functional Differential Equations
• Error Bounds for Monotone Approximation Schemes for Hamilton--Jacobi--Bellman Equations
• Numerical approximations for nonlinear stochastic systems with delays
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item