Simultaneous recurrent conditions on countable state Markov chains

DOI10.1080/02522667.1996.10699290zbMath0879.60066OpenAlexW2012166615MaRDI QIDQ4344287

Yoshinobu Kadota

Publication date: 15 July 1997

Published in: Journal of Information and Optimization Sciences (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1080/02522667.1996.10699290

zbMATH Keywords

Markov chainscountable state spacerecurrent conditions

Mathematics Subject Classification ID

Markov chains (discrete-time Markov processes on discrete state spaces) (60J10)

Cites Work

• Unnamed Item
• Unnamed Item
• Continuity of mean recurrence times in denumerable semi-Markov processes
• Optimality equations and sensitive optimality in bounded Markov decision processes¹
• Average, Sensitive and Blackwell Optimal Policies in Denumerable Markov Decision Chains with Unbounded Rewards
• Blackwell optimal policies in a Markov decision process with a Borel state space
• Discrete Dynamic Programming with a Small Interest Rate
• Discrete Dynamic Programming with Sensitive Discount Optimality Criteria
• Perturbation theory and finite Markov chains

This page was built for publication: Simultaneous recurrent conditions on countable state Markov chains