On structural properties of optimal average cost functions in Markov decision processes with Borel spaces and universally measurable policies
type: Item
instance of: scholarly article
title: On structural properties of optimal average cost functions in Markov decision processes with Borel spaces and universally measurable policies
zbMATH Open document ID: 1483.90175
author: Huizhen Yu
published in: Journal of Mathematical Analysis and Applications
publication date: 2022-01-21T00:00:00Z
Mathematics Subject Classification ID: 90C40
zbMATH DE Number: 7461205
zbMATH Keywords: Markov decision processes
zbMATH Keywords: universally measurable policies
zbMATH Keywords: average cost
zbMATH Keywords: submartingales
zbMATH Keywords: reachability
zbMATH Keywords: recurrent Markov chains
MaRDI profile type: Publication
full work available at URL: j.jmaa.2021.125954
OpenAlex ID: W4200430873
cites work: Discrete-Time Controlled Markov Processes with Average Cost Criterion: A Survey
cites work: Optimal decision procedures for finite Markov chains. Part II: Communicating systems
cites work: Stochastic optimal control. The discrete time case
cites work: An expected average reward criterion
cites work: A Borel Set Not Containing a Graph
cites work: The optimal reward operator in dynamic programming
cites work: A convex analytic approach to Markov decision processes
cites work: Q4547443
cites work: LP Formulations of Discrete Time Long-Run Average Optimal Control Problems: The NonErgodic Case
cites work: Q3827813
cites work: A counterexample on the optimality equation in Markov decision chains with the average cost criterion
cites work: Average control of Markov decision processes with Feller transition probabilities and general action spaces
cites work: Real Analysis and Probability
cites work: Q3862198
cites work: An $\varepsilon $-Optimal Control of a Finite Markov Chain with an Average Reward Criterion
cites work: Fatou's Lemma in Its Classical Form and Lebesgue's Convergence Theorems for Varying Measures with Applications to Markov Decision Processes
cites work: Average cost Markov decision processes with weakly continuous transition probabilities
cites work: An Example in Denumerable Decision Processes
cites work: Q4132091
cites work: Q4255598
cites work: Recurrence conditions for Markov decision processes with Borel state space: A survey
cites work: Infinite-horizon Markov control processes with undiscounted cost criteria: from average to overtaking optimality
cites work: Linear programming formulation of MDPs in countable state space: The multichain case
cites work: Semi-Markov control processes with non-compact action spaces and discontinuous costs
cites work: On the optimality equation for average cost Markov control processes with Feller transition probabilities
cites work: Subadditive mean ergodic theorems
cites work: Markov Decision Processes with a Borel Measurable Cost Function—The Average Case
cites work: The Existence of a Minimum Pair of State and Policy for Markov Decision Processes under the Hypothesis of Doeblin
cites work: Markov Chains and Stochastic Stability
cites work: The policy iteration algorithm for average reward Markov decision processes with general state space
cites work: Q4114574
cites work: General Irreducible Markov Chains and Non-Negative Operators
cites work: Q4048325
cites work: Q4735696
cites work: Technical Note—Improved Conditions for Convergence in Undiscounted Markov Renewal Programming
cites work: Remarks on analytic sets
cites work: Average Optimality in Dynamic Programming with General State Space
cites work: Alternative Theoretical Frameworks for Finite Horizon Discrete-Time Stochastic Optimal Control
cites work: Universally Measurable Policies in Dynamic Programming
cites work: Q4396494
cites work: Negative Dynamic Programming
cites work: The average cost optimality equation: a fixed point approach
cites work: Solutions of the average cost optimality equation for Markov decision processes with weakly continuous kernel: the fixed-point approach revisited
cites work: Average Cost Optimality Inequality for Markov Decision Processes with Borel Spaces and Universally Measurable Policies
cites work: On the Minimum Pair Approach for Average Cost Markov Decision Processes with Countable Discrete Action Spaces and Strictly Unbounded Costs
DOI: 10.1016/J.JMAA.2021.125954
description: scientific article; zbMATH DE number 7461205