A new condition for the existence of optimal stationary policies in average cost Markov decision processes
type: Item
instance of: scholarly article
title: A new condition for the existence of optimal stationary policies in average cost Markov decision processes
zbMATH Open document ID: 0593.90083
DOI: 10.1016/0167-6377(86)90095-7
author: Linn I. Sennott
published in: Operations Research Letters
publication date: 1986-01-01T00:00:00Z
review text: The author considers a discrete time, countable state Markov decision processes with finite decision sets and bounded costs. He obtains conditions under which (possibly) unbounded solution to the average cost equation for the optimal value exists and yields an optimal stationary policy. In the special case in which every stationary policy induces an ergodic Markov chain, he obtains a new form for the optimality equation and gives a sufficient condition for the existence of an optimal stationary policy. The results are illustrated by some examples.
reviewed by: Shmuel Gal
Mathematics Subject Classification ID: 90C40
Mathematics Subject Classification ID: 90C15
Mathematics Subject Classification ID: 90C39
zbMATH DE Number: 3954678
zbMATH Keywords: stochastic dynamic programming
zbMATH Keywords: discrete time, countable state Markov decision processes
zbMATH Keywords: finite decision sets
zbMATH Keywords: bounded costs
zbMATH Keywords: optimal stationary policy
zbMATH Keywords: ergodic Markov chain
zbMATH Keywords: optimality equation
MaRDI profile type: Publication
full work available at URL: 0167-6377(86)90095-7
OpenAlex ID: W2033474053
cites work: Denumerable State Markovian Decision Processes-Average Cost Criterion
cites work: On the Stochastic Matrices Associated with Certain Queuing Processes
cites work: Q3313617
cites work: Some Conditions for Ergodicity and Recurrence of Markov Chains
cites work: Non-Discounted Denumerable Markovian Decision Models
cites work: Q3683893
cites work: Technical Note—Mean Drifts and the Non-Ergodicity of Markov Chains
cites work: Technical Note—An Equivalence Between Continuous and Discrete Time Markov Decision Processes
cites work: Criteria for strong ergodicity of Markov chains
cites work: The existence of moments for stationary Markov chains
cites work: Optimal control of service rates in networks of queues
description: scientific article; zbMATH DE number 3954678