Nonstationary Markov decision problems with converging parameters
type: Item
instance of: scholarly article
title: Nonstationary Markov decision problems with converging parameters
zbMATH Open document ID: 0426.90091
DOI: 10.1007/BF00935474
published in: Journal of Optimization Theory and Applications
publication date: 1981-01-01T00:00:00Z
Mathematics Subject Classification ID: 90C47
Mathematics Subject Classification ID: 41A25
zbMATH DE Number: 3664766
zbMATH Keywords: modified value-iteration method
zbMATH Keywords: discounted version
zbMATH Keywords: undiscounted version
zbMATH Keywords: optimal policies
zbMATH Keywords: asymptotic behavior
zbMATH Keywords: non-stationary Markov decision problems
zbMATH Keywords: approximations for parameters
zbMATH Keywords: convergence rates
author: Awi Federgruen
author: Paul J. Schweitzer
MaRDI profile type: Publication
cites work: Technical Note—Elimination of Suboptimal Actions in Markov Decision Problems
cites work: Tests for Suboptimal Actions in Discounted Markov Programming
cites work: Letter to the Editor—A Test for Suboptimal Actions in Markovian Decision Problems
cites work: Some Bounds for Discounted Sequential Decision Processes
cites work: Q3908795
cites work: Note—A Test for Nonoptimal Actions in Undiscounted Finite Markov Decision Chains
cites work: Contraction mappings underlying undiscounted Markov decision problems
cites work: Q4051876
cites work: Quasi-Newton Methods for Unconstrained Optimization
cites work: On Finding the Maximal Gain for Markov Decision Processes
cites work: Markov-Renewal Programming. I: Formulation, Finite Return Models
cites work: An Optimal Policy for Operating a Multipurpose Reservoir
cites work: Q4194768
cites work: A general markov decision method II: Applications
cites work: Applying a New Device in the Optimization of Exponential Queuing Systems
cites work: Iterative solution of the functional equations of undiscounted Markov renewal programming
cites work: Markov Renewal Programs with Small Interest Rates
cites work: Discrete Dynamic Programming with a Small Interest Rate
cites work: Discrete Dynamic Programming with Sensitive Discount Optimality Criteria
cites work: Stochastic Games
cites work: Contraction Mappings in the Theory Underlying Dynamic Programming
cites work: Dynamic programming, Markov chains, and the method of successive approximations
cites work: On the Iterative Method of Dynamic Programming on a Finite Space Discrete Time Markov Process
cites work: Étude asymptotique des systèmes markoviens à commande
cites work: The Asymptotic Behavior of Undiscounted Value Iteration in Markov Decision Problems
cites work: Geometric convergence of value-iteration in multichain Markov decision problems
cites work: Q3908792
cites work: Multichain Markov Renewal Programs
cites work: Exponential convergence of products of stochastic matrices
cites work: Towards consensus: some convergence theorems on repeated averaging
cites work: The rate of convergence for backwards products of a convergent sequence of finite Markov matrices
cites work: The rate of convergence of certain nonhomogeneous Markov chains
cites work: Perturbation theory and finite Markov chains
description: scientific article; zbMATH DE number 3664766