Approximation of average cost optimal policies for general Markov decision processes with unbounded costs
type: Item
instance of: scholarly article
title: Approximation of average cost optimal policies for general Markov decision processes with unbounded costs
zbMATH Open document ID: 0882.90127
DOI: 10.1007/BF01193864
published in: Mathematical Methods of Operations Research
publication date: 1997-08-05T00:00:00Z
Mathematics Subject Classification ID: 90C40
zbMATH DE Number: 1044310
zbMATH Keywords: average cost criterion
zbMATH Keywords: value iteration
zbMATH Keywords: approximation of optimal policy
zbMATH Keywords: geometrical convergence
zbMATH Keywords: Lyapunov-like ergodicity conditions
zbMATH Keywords: Markov decision processes
zbMATH Keywords: Borel state space
author: Evgueni Gordienko
author: Raúl Montes-de-Oca
author: Adolfo Minjárez-sosa
MaRDI profile type: Publication
cites work: Perturbation and stability theory for Markov control problems
cites work: Discrete-Time Controlled Markov Processes with Average Cost Criterion: A Survey
cites work: Stochastic optimal control. The discrete time case
cites work: A note on the vanishing interest rate approach in average Markov decision chains with continuous and bounded costs
cites work: Value iteration in a class of average controlled Markov chains with unbounded costs: necessary and sufficient conditions for pointwise convergence
cites work: Equivalence of Lyapunov stability criteria in a class of Markov decision processes
cites work: Perturbation theory for unbounded Markov reward processes with applications to queueing
cites work: Perturbation theory for Markov reward processes with applications to queueing systems
cites work: Q3206684
cites work: Adaptive Strategies for Certain Classes of Controlled Markov Processes
cites work: An estimate of the stability of optimal control of certain stochastic and deterministic systems
cites work: Average cost Markov control processes with weighted norms: existence of canonical policies
cites work: Average cost Markov control processes with weighted norms: value iteration
cites work: Adaptive Markov control processes
cites work: Infinite-horizon Markov control processes with undiscounted cost criteria: from average to overtaking optimality
cites work: Q5599448
cites work: Sensitive Optimality Criteria in Countable State Dynamic Programming
cites work: The asymptotic behaviour of the minimal total expected cost for the denumerable state Markov decision model
cites work: Inequalities in Theorems of Ergodicity and Stability for Markov Chains with Common Phase Space. II
cites work: Markov chains and stochastic stability
cites work: Value iteration in average cost Markov control processes on Borel spaces
cites work: General Irreducible Markov Chains and Non-Negative Operators
cites work: Measurable selection theorems for optimization problems
cites work: Value iteration in countable state average cost Markov decision processes with unbounded costs
cites work: Dynamic programming, Markov chains, and the method of successive approximations
full work available at URL: https://doi.org/10.1007/bf01193864
OpenAlex ID: W2037038863
description: scientific article; zbMATH DE number 1044310