Discretization procedures for adaptive Markov control processes
From MaRDI portal
Publication:1123872
DOI10.1016/0022-247X(89)90259-XzbMath0677.93073OpenAlexW2032419970MaRDI QIDQ1123872
Steven I. Marcus, Onésimo Hernández-Lerma
Publication date: 1989
Published in: Journal of Mathematical Analysis and Applications (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.1016/0022-247x(89)90259-x
infinite horizonparameter estimationdiscrete-timeasymptotically optimaluniform approximationsadaptive Markov control processesunknown disturbance distribution
Lua error in Module:PublicationMSCList at line 37: attempt to index local 'msc_result' (a nil value).
Related Items (4)
A convex optimization approach to dynamic programming in continuous state and action spaces ⋮ Note on stability estimation in average Markov control processes ⋮ Value iteration in average cost Markov control processes on Borel spaces ⋮ A perturbation approach to approximate value iteration for average cost Markov decision processes with Borel spaces and bounded costs
Cites Work
- Adaptive control of discounted Markov decision chains
- Adaptive policies for discrete-time stochastic control systems with unknown disturbance distribution
- Continuous dependence of stochastic control models on the noise distribution
- Nonstationary Markov decision problems with converging parameters
- Stochastic optimal control. The discrete time case
- Empirical processes: A survey of results for independent and identically distributed random variables
- Approximation and bounds in discrete event dynamic programming
- Estimation and control in discounted stochastic dynamic programming
- Strongly consistent estimation in a controlled Markov renewal model
- Convergence of Dynamic Programming Models
- Convergence of discretization procedures in dynamic programming
- Optimal Plans for Dynamic Programming Problems
- Approximations of Dynamic Programs, I
- Approximations of Dynamic Programs, II
- An Approach to Discrete-Time Stochastic Control Problems under Partial Observation
- Estimation and control in Markov chains
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
This page was built for publication: Discretization procedures for adaptive Markov control processes
