Some reward paths in semi-Markov models with stochastic selection of the transition probabilities

DOI10.1007/S11009-007-9027-5zbMath1128.60075OpenAlexW2079819944MaRDI QIDQ2462654

Aleka A. Papadopoulou, George Tsaklidis

Publication date: 3 December 2007

Published in: Methodology and Computing in Applied Probability (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1007/s11009-007-9027-5

zbMATH Keywords

stochastic selectionsemi-Markov processrewards

Mathematics Subject Classification ID

Markov renewal processes, semi-Markov processes (60K15)

Related Items (10)

The Augmented Semi-Markov System in Continuous Time ⋮ Optimizing cost-effectiveness in a stochastic Markov manpower planning system under control by recruitment ⋮ On the moments and the distribution of the cost of a semi Markov model for healthcare systems ⋮ The quality of life via semi Markov reward modelling ⋮ Fuzzy semi-Markov migration process in credit risk ⋮ Performance analysis of second order semi-Markov chains: an application to wind energy production ⋮ Some Results on Modeling Biological Sequences and Web Navigation with a Semi Markov Chain ⋮ The augmented semi-Markov system and its asymptotic behaviour ⋮ Rate of convergence in fuzzy non homogeneous Markov systems ⋮ The multivariate non-homogeneous Markov manpower system in a departmental mobility framework

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Finite non-homogeneous semi-Markov processes: Theoretical and computational aspects
• A bibliography on semi-Markov processes
• Asymptotic behavior of nonhomogeneous semi-Markov systems
• A semi-Markov model for a multigrade population with Poisson recruitment
• A multivariate reward process defined on a semi-Markov process and its first-passage-time distributions
• Non-homogeneous semi-Markov systems and maintainability of the state sizes
• Exceptional Paper—Markov Renewal Theory: A Survey
• Reward processes for semi-Markov processes: asymptotic behaviour
• Partially observable semi-Markov reward processes
• Limit Theorems for Markov Renewal Processes
• The Integral of a Step Function Defined on a Semi-Markov Process
• On the Matrix Renewal Function for Markov Renewal Processes
• Markov renewal theory
• A process by chain dependent growth rate. part II: The ruin and ergodic problems
• On Average Reward Semi-Markov Decision Processes with a General Multichain Structure
• Control of asymptotic variability in non-homogeneous Markov systems

This page was built for publication: Some reward paths in semi-Markov models with stochastic selection of the transition probabilities