Markov Renewal Processes with Finitely Many States

DOI10.1214/aoms/1177704864zbMath0201.49901OpenAlexW1966617542MaRDI QIDQ5600529

Publication date: 1961

Published in: The Annals of Mathematical Statistics (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1214/aoms/1177704864

Related Items

Ergodic and ratio limit theorems for ?-recurrent semi-Markov processes, Bayesian prediction of waiting times in stochastic models, Discrete Time Reward Models for Homogeneous Semi-Markov Systems, Numerical Treatment of Homogeneous and Non-homogeneous Semi-Markov Reliability Models, A Phase-Type Semi-Markov Point Process, Construction of a semi-Markov model for the performance of a football team in the presence of missing data, Two Types ofRG-Factorizations of Quasi-birth-and-death Processes and Their Applications to Stochastic Integral Functionals, Large deviations of uniformly recurrent Markov additive processes, Transient analysis of hierarchical semi-Markov process models with tool support in Stateflow, Earthquake forecasting based on multi-state system methodology, The uniform CLT for the empirical estimator of countable state space semi-Markov kernels indexed by functions with applications, Parametric inference for time-to-failure in multi-state semi-Markov models: A comparison of marginal and process approaches, On semi-Markov processes and their Kolmogorov's integro-differential equations, Exponential and gamma form for tail expansions of first-passage distributions in semi-markov processes, Terminating markov renewal processes, On the asymptotic properties of some kernel estimators for continuous-time semi-Markov processes, A fundamental matrix for regular semi-Markov processes, Exchangeably weighted bootstraps of empirical estimators of a semi-Markov kernel, Numerical computation of mean passage times and absorption probabilities in Markov and Semi-Markov models, Stochastic models for an enzyme reaction in an open linear system, On general bootstrap of empirical estimator of a semi-Markov kernel with applications, Semi-stationary processes, A note on the matrix renewal function, On the construction of component importance measures for semi-Markov systems, Semimartingale representation of a class of semi-Markov dynamics, Semi-Markov processes in modelling and reliability: A new approach, The scaling limits of a heavy tailed Markov renewal process, Modelling heterogeneity in a manpower system: a review, A multi-dimensional renewal theorem for finite Markov chains, The first-passage times of phase semi-Markov processes, A semi-Markov approach to the stock valuation problem, Reliabilities for feedback systems and their saddlepoint approximation., Semi-additive functionals of semi-Markov processes and measure-valued Poisson equation, Unnamed Item, On a multidimensional general bootstrap for empirical estimator of continuous-time semi-Markov kernels with applications, Random evolution equations: well-posedness, asymptotics, and applications to graphs, Repair limit replacement policies with lead time, Use of Bayesian Analysis of Semi-Markov Process Models to Study Consumer Buying Behavior, Hypotheses testing and posterior concentration rates for semi-Markov processes, Analysis of \(GI/ M/ n/ n\) queueing system with ordered entry and no waiting line, Bayesian nonparametric estimation for reinforced Markov renewal processes, Discrete-Time Semi-Markov Random Evolutions and their Applications, Multistate Survival Models as Transient Electrical Networks, Extended stochastic Petri net models for systems with parallel and cooperative motions, Optimal dental scheduling, A \(\chi^2\) goodness-of-fit test for Markov renewal processes, A stochastic theory of matching processes, Semi-Markov processes and their applications, Optimum checking request policies, Exact distributions for reward functions on semi-Markov and Markov additive processes, The uniform CLT for empirical estimator of a general state space semi-Markov kernel indexed by functions, A semi-martingale representation for a semi-Markov chain with application to finance, On discrete-time semi-Markov processes, Kemeny's function for Markov chains and Markov renewal processes, Loop-free Markov chains as determinantal point processes, Numerical approximation of probability mass functions via the inverse discrete Fourier transform, Time Dependent Availability of K-out-of-N:G Systems with Exponential Failures and General Repairs, Monte Carlo simulation of random walks with residence time dependent transition probability rates, A transient solution method for semi-Markov systems, Analyses of subensembles of M/G/1 queueing sequences, Potentials associated with recurrent Markov renewal processes, The optimization of K-effect models by linear and dynamic programming, On the limiting distributions in Markov renewal processes with finitely many states, On Discrete Time Semi-Markov Chains and Applications in Words Occurrences, Linear programming algorithms for semi-Markovian decision processes, Occupation Times for Markov and Semi-Markov Chains, Generalized renewal functions and stationary inventory models, Output flow of single-line queuing systems, Scalar timing and semi-Markov chains in free-operant avoidance, A fitting algorithm for Markov-modulated Poisson processes having two arrival rates, On discrete time Prabhakar-generalized fractional Poisson processes and related stochastic dynamics, Dynamic analysis of a unified multivariate counting process and its asymptotic behavior, On a semi-Markov generalization of the random walk, Optimum preventive maintenance policies maximizing the mean time to the first system failure for a two-unit standby redundant system, Stationary semi-Markov models in risk and queueing theories, A stochastic model of human reproduction: Some preliminary results, DYNAMIC ANALYSIS OF A MULTIVARIATE REWARD PROCESS DEFINED ON THE UMCP WITH APPLICATION TO OPTIMAL PREVENTIVE MAINTENANCE POLICY PROBLEMS IN MANUFACTURING, Finite non-homogeneous semi-Markov processes: Theoretical and computational aspects, A computational procedure for the asymptotic analysis of homogeneous semi-Markov processes, On the Weak Convergence of an Empirical Estimator of the Discrete-Time Semi-Markov Kernel, A method to abstract a stochastic Petri net., A long period multistate life table using micro data, Nonparametric reliability estimation of semi-Markov processes, A multidimensional functional central limit theorem for an empirical estimator of a continuous-time semi-Markov kernel, Homogeneous semi-Markov reliability models for credit risk management