Value iteration in countable state average cost Markov decision processes with unbounded costs
type: Item
instance of: scholarly article
title: Value iteration in countable state average cost Markov decision processes with unbounded costs
zbMATH Open document ID: 0729.90088
DOI: 10.1007/BF02055585
author: Linn I. Sennott
published in: Annals of Operations Research
publication date: 1991-01-01T00:00:00Z
Mathematics Subject Classification ID: 90C40
Mathematics Subject Classification ID: 60K25
Mathematics Subject Classification ID: 90B22
Mathematics Subject Classification ID: 90C39
Mathematics Subject Classification ID: 90-08
zbMATH DE Number: 4207246
zbMATH Keywords: countable state Markov decision processes
zbMATH Keywords: finite action sets
zbMATH Keywords: unbounded costs
zbMATH Keywords: expected average cost optimal stationary policy
zbMATH Keywords: undiscounted value iteration
zbMATH Keywords: variable service rates
zbMATH Keywords: variable arrival parameter
MaRDI profile type: Publication
cites work: Adaptive Markov control processes
cites work: The asymptotic behaviour of the minimal total expected cost for the denumerable state Markov decision model
cites work: Some Conditions for Ergodicity and Recurrence of Markov Chains
cites work: Q3683893
cites work: The Asymptotic Behavior of Undiscounted Value Iteration in Markov Decision Problems
cites work: A new condition for the existence of optimal stationary policies in average cost Markov decision processes
cites work: Average Cost Optimal Stationary Policies in Infinite State Markov Decision Processes with Unbounded Costs
cites work: Average Cost Semi-Markov Decision Processes and the Control of Queueing Systems
cites work: Hitting times of Markov chains, with application to state-dependent queues
cites work: Dynamic programming, Markov chains, and the method of successive approximations
description: scientific article; zbMATH DE number 4207246