A note on simultaneous recurrence conditions on a set of denumerable stochastic matrices

DOI10.2307/3213439zbMath0395.60058OpenAlexW4236017626MaRDI QIDQ4178271

Arie Hordijk, Awi Federgruen, Henk C. Tijms

Publication date: 1978

Published in: Journal of Applied Probability (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.2307/3213439

zbMATH Keywords

EquivalencesCompact Metric Set of Denumberable Stochastic MatricesDoeblin ConditionQuasicompactness ConditionScrambling ConditionSimultaneous Recurrence Conditions

Mathematics Subject Classification ID

Markov chains (discrete-time Markov processes on discrete state spaces) (60J10)

Related Items (14)

On undiscounted semi-Markov decision processes with absorbing states ⋮ Recurrence conditions for Markov decision processes with Borel state space: A survey ⋮ Necessary and sufficient conditions for a bounded solution to the optimality equation in average reward Markov decision chains ⋮ Necessary conditions for the optimality equation in average-reward Markov decision processes ⋮ Computing semi-stationary optimal policies for multichain semi-Markov decision processes ⋮ Denumerable state semi-Markov decision processes with unbounded costs, average cost criterion ⋮ Zero-sum risk-sensitive stochastic games on a countable state space ⋮ Elimination of eanlomization in semi-Markov decision models with average cost criterion ⋮ Recent results on conditions for the existence of average optimal stationary policies ⋮ Semi-Markov decision processes with limiting ratio average rewards ⋮ Characterization and sufficient conditions for normed ergodicity of Markov chains ⋮ On zero-sum two-person undiscounted semi-Markov games with a multichain structure ⋮ Semi-Markov decision processes with vector pay-offs ⋮ Finite state approximation algorithms for average cost denumerable state Markov decision processes

This page was built for publication: A note on simultaneous recurrence conditions on a set of denumerable stochastic matrices