Finite-state approximations for denumerable multidimensional state discounted Markov decision processes

DOI10.1016/0022-247X(86)90311-2zbMath0597.90092MaRDI QIDQ1079512

Onésimo Hernández-Lerma

Publication date: 1986

Published in: Journal of Mathematical Analysis and Applications (Search for Journal in Brave)

zbMATH Keywords

denumerable multidimensional state spacedenumerable-state Markov decision processesdiscount optimal stationary policy

Mathematics Subject Classification ID

Markov and semi-Markov decision processes (90C40)

Related Items (2)

Asymptotic properties of constrained Markov Decision Processes ⋮ Decentralized stochastic control

Cites Work

• Unnamed Item
• Optimal adaptive control of priority assignment in queueing systems
• Finite state approximations for denumerable state infinite horizon discounted Markov decision processes with unbounded rewards
• Adaptive control of discounted Markov decision chains
• Nonstationary value-iteration and adaptive control of discounted semi- Markov processes
• Nonstationary Markov decision problems with converging parameters
• Finite-state approximations for denumerable-state infinite-horizon discounted Markov decision processes
• Finite-state approximations to denumerable-state dynamic programs
• Estimation and control in discounted stochastic dynamic programming
• Queueing Models for Computer Communications System Analysis
• Estimation and control in Markov chains

This page was built for publication: Finite-state approximations for denumerable multidimensional state discounted Markov decision processes