The average cost of Markov chains subject to total variation distance uncertainty
type: Item
instance of: scholarly article
title: The average cost of Markov chains subject to total variation distance uncertainty
zbMATH Open document ID: 1408.93150
author: I. Tzortzis
author: Andreas A. Malikopoulos
author: Charalambos D. Charalambous
published in: Systems \& Control Letters
publication date: 2019-02-27T00:00:00Z
Mathematics Subject Classification ID: 93E20
Mathematics Subject Classification ID: 60J20
Mathematics Subject Classification ID: 93C41
zbMATH DE Number: 7030026
zbMATH Keywords: stochastic optimal control
zbMATH Keywords: controlled Markov chain
zbMATH Keywords: average cost
zbMATH Keywords: total variation distance
MaRDI profile type: Publication
full work available at URL: j.sysconle.2018.08.003
OpenAlex ID: W2891617654
cites work: On Controlled Finite State Markov Processes with Compact Control Sets
cites work: Discrete-Time Controlled Markov Processes with Average Cost Criterion: A Survey
cites work: A Controlled Finite Markov Chain with an Arbitrary Set of Decisions
cites work: The Existence of a Stationary $\varepsilon $-Optimal Policy for a Finite Markov Chain
cites work: Optimal and suboptimal stationary controls for Markov chains
cites work: Q4045930
cites work: Q3487241
cites work: Q3266141
cites work: Q3996911
cites work: Optimal decision procedures for finite markov chains. Part I: Examples
cites work: Finite state Markov decision models with average reward criteria
cites work: Q4771778
cites work: On Minimum Cost Per Unit Time Control of Markov Chains
cites work: Q3815237
cites work: Control of Markov Chains with Long-Run Average Cost Criterion: The Dynamic Programming Equations
cites work: Controlled Markov chains with constraints.
cites work: Another set of conditions for average optimality in Markov control processes
cites work: Value Iteration in a Class of Communicating Markov Decision Chains with the Average Cost Criterion
cites work: Uniqueness and Stability of Optimal Policies of Finite State Markov Decision Processes
cites work: A Duality Framework for Stochastic Optimal Control of Complex Systems
cites work: Probability and random processes.
cites work: Extremum Problems With Total Variation Distance and Their Applications
cites work: Information Theory and Statistical Mechanics
cites work: Modeling by shortest data description
cites work: Approximation of Markov Processes by Lower Dimensional Processes via Total Variation Metrics
cites work: Optimal Kullback-Leibler Aggregation via Spectral Theory of Markov Chains
DOI: 10.1016/J.SYSCONLE.2018.08.003
Recommended article: Discounted approximations to the risk-sensitive average cost in finite Markov chains
Recommended article: Approximation of average cost Markov decision processes using empirical distributions and concentration inequalities
Recommended article: Average cost Markov decision processes under the hypothesis of Doeblin
Recommended article: Average Cost Markov Decision Processes with Semi-Uniform Feller Transition Probabilities
Recommended article: On the total variation distance of labelled Markov chains
Recommended article: Q4355099
Recommended article: Average cost Markov decision processes with weakly continuous transition probabilities
Recommended article: On the Total Variation Distance of Semi-Markov Chains
Recommended article: Average cost Markov decision processes: Optimality conditions
description: scientific article; zbMATH DE number 7030026