Continuity of mean recurrence times in denumerable semi-Markov processes

DOI10.1007/BF00532668zbMath0562.60071OpenAlexW2085152144MaRDI QIDQ3675277

Hans Deppe

Publication date: 1985

Published in: Zeitschrift für Wahrscheinlichkeitstheorie und verwandte Gebiete (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1007/bf00532668

zbMATH Keywords

semi-Markov processescontinuity of the number of recurrent classestightness of the limiting distributions

Mathematics Subject Classification ID

Markov chains (discrete-time Markov processes on discrete state spaces) (60J10) Markov renewal processes, semi-Markov processes (60K15)

Related Items (3)

Optimality equations and sensitive optimality in bounded Markov decision processes¹ ⋮ Simultaneous recurrent conditions on countable state Markov chains ⋮ On the chance to visit a goal set infinitely often

Cites Work

• Denumerable state semi-Markov decision processes with unbounded costs, average cost criterion
• On the Existence of Average Optimal Policies in Semiregenerative Decision Models
• The optimality equation in average cost denumerable state semi-Markov decision problems, recurrency conditions and algorithms
• Stationary Markovian Decision Problems and Perturbation Theory of Quasi-Compact Linear Operators
• Periodicity in Markov renewal theory
• The Existence and Uniqueness of Stationary Measures for Markov Renewal Processes
• Perturbation theory and finite Markov chains
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item

This page was built for publication: Continuity of mean recurrence times in denumerable semi-Markov processes