Markov chain approximation for Hamilton-Jacobi-Bellman equation with absorbing boundary
From MaRDI portal
Publication:6490239
DOI10.1137/23M1565723MaRDI QIDQ6490239
Publication date: 23 April 2024
Published in: SIAM Journal on Control and Optimization (Search for Journal in Brave)
optimal controlHamilton-Jacobi-Bellman equationviscosity solutionvalue functionMarkov chain approximationcontrolled Markov jump process
Markov chains (discrete-time Markov processes on discrete state spaces) (60J10) Stability and convergence of numerical methods for boundary value problems involving PDEs (65N12) Viscosity solutions to PDEs (35D40) Hamilton-Jacobi equations (35F21) Jump processes on general state spaces (60J76)
Cites Work
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Approximate solutions of the Bellman equation of deterministic control theory
- Continuous-time stochastic control and optimization with financial applications
- On a discrete approximation of the Hamilton-Jacobi equation of dynamic programming
- High density limit theorems for nonlinear chemical reactions with diffusion
- Law of large numbers and central limit theorem for linear chemical reactions with diffusion
- Approximation and regular perturbation of optimal control problems via Hamilton-Jacobi theory
- Comparison of stochastic and deterministic models of a linear chemical reaction with diffusion
- Law of large numbers in the supremum norm for a chemical reaction with diffusion
- Probabilistic methods for finite difference approximations to degenerate elliptic and parabolic equations with Neumann and Dirichlet boundary conditions
- Approximating value functions for controlled degenerate diffusion processes by using piece-wise constant policies.
- Optimal control of Markov jump processes: asymptotic analysis, algorithms and applications to the modeling of chemical reaction systems
- Law of large numbers and central limit theorem for a class of pure jump Markov process
- Controlled Markov processes and viscosity solutions
- Diffusion limits for a nonlinear density dependent space-time population model
- ON APPROXIMATION OF VALUE FUNCTIONS FOR CONTROLLED DISCONTINUOUS RANDOM PROCESSES
- Some Properties of Viscosity Solutions of Hamilton-Jacobi Equations
- Optimal Control with State-Space Constraint I
- Viscosity Solutions of Hamilton-Jacobi Equations
- Optimal Control with State-Space Constraint. II
- Solutions of ordinary differential equations as limits of pure jump markov processes
- Limit theorems for sequences of jump Markov processes approximating ordinary differential processes
This page was built for publication: Markov chain approximation for Hamilton-Jacobi-Bellman equation with absorbing boundary