Regenerative Analysis and Steady State Distributions for Markov Chains
From MaRDI portal
Publication:3696262
DOI10.1287/opre.33.5.1107zbMath0576.60083OpenAlexW1988914905MaRDI QIDQ3696262
Daniel P. Heyman, Winfried K. Grassmann, Michael I. Taksar
Publication date: 1985
Published in: Operations Research (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.1287/opre.33.5.1107
Queueing theory (aspects of probability theory) (60K25) Markov chains (discrete-time Markov processes on discrete state spaces) (60J10) Applications of renewal theory (reliability, demand theory, etc.) (60K10) Renewal theory (60K05)
Related Items (82)
Perturbation results for nearly uncoupled Markov chains with applications to iterative methods ⋮ Entrywise perturbation theory and error analysis for Markov chains ⋮ Stability of a two-queue cyclic polling system with BMAPs under gated service and state-dependent time-limited service disciplines ⋮ Numerical method for discrete-time finite-buffer queues with some regenerative structure ⋮ ON LATOUCHE–RAMASWAMI'S LOGARITHMIC REDUCTION ALGORITHM FOR QUASI-BIRTH-AND-DEATH PROCESSES ⋮ On a two-level multigrid solution method for finite Markov chains ⋮ A detailed note on the finite-buffer queueing system with correlated batch-arrivals and batch-size-/phase-dependent bulk-service ⋮ Analysis of the asymmetric shortest queue problem ⋮ A Positivity Preserving Inverse Iteration for Finding the Perron Pair of an Irreducible Nonnegative Third Order Tensor ⋮ The snowball effect of customer slowdown in critical many-server systems ⋮ The computation of key properties of Markov chains via perturbations ⋮ Continue, quit, restart probability model ⋮ Modelling traffic queues at a signalized intersection with vehicle- actuated control and Markovian arrival processes ⋮ Complete analysis of finite and infinite buffer \(GI/MSP/1\) queue-a computational approach ⋮ On the batch arrival batch service queue with finite buffer under server's vacation: \(MX/GY/1/N\) queue ⋮ Analyzing the finite buffer batch arrival queue under Markovian service process: \(\mathrm{GI}^X /\mathrm{MSP}/1/\mathrm{N}\) ⋮ Analysis of the stationary \(E_ k/C_ 2/s\) queueing system ⋮ Optimal Stopping of Seasonal Observations and Projection of a Markov Chain ⋮ Stationary distributions in a queueing system with vacation times and limited service ⋮ Computing absorption probabilities for a Markov chain ⋮ Newton-noda iteration for finding the Perron pair of a weakly irreducible nonnegative tensor ⋮ Numerical computation of mean passage times and absorption probabilities in Markov and Semi-Markov models ⋮ Exploiting the Toeplitz structure in certain queueing problems ⋮ A simple and efficient computing procedure of the stationary system-length distributions for \(G I^X / D / c\) and \(B M a P / D / c\) queues ⋮ Comparacion numerica de algoritmos para calcular distribuciones estacionarias de cadenas de Markov finitas ⋮ Security screening queues with impatient applicants: a new model with a case study ⋮ Accurate inverses for computing eigenvalues of extremely ill-conditioned matrices and differential operators ⋮ Red light green light method for solving large Markov chains ⋮ On the finite buffer queue with renewal input and batch Markovian service process: \(\mathrm{GI}/\mathrm{BMSP}/1/N\) ⋮ A note on Newton-Noda iteration for computing the Perron pair of a weakly irreducible nonnegative tensor ⋮ Four Canadian Contributions to Stochastic Modeling ⋮ Accurate solutions of \(M\)-matrix Sylvester equations ⋮ Rapid, efficient analysis of the \(\lambda(n)/C_{k}/r/N\) queue, with application to decomposition of closed queuing networks. ⋮ Finite-state-space truncations for infinite quasi-birth-death processes ⋮ Matrix Structures in Queuing Models ⋮ On a direct method for the solution of nearly uncoupled Markov chains ⋮ Performance and stability of direct methods for computing generalized inverses of the graph Laplacian ⋮ Asymptotic Expansions for Stationary Distributions of Perturbed Semi-Markov Processes ⋮ Stationary analysis of a BMAP/R/1 queue with R-type multiple working vacations ⋮ Analysis of queue-length dependent vacations and P-limited service in \(\mathrm{BMAP}/\mathrm{G}/1/N\) systems: stationary distributions and optimal control ⋮ A direct projection method for Markov chains ⋮ Finding equilibrium probabilities of QBD processes by spectral methods when eigenvalues vanish ⋮ Probabilistic approach to computational algorithms for finding stationary distributions of Markov chains ⋮ Analysis of a discrete-time queue with load dependent service under discrete-time Markovian arrival process ⋮ Fast multilevel methods for Markov chains ⋮ Using state reduction for computing steady state vectors in Markov chains of \(M/G/1\) type ⋮ The computation of the mean first passage times for Markov chains ⋮ Computing the fundamental matrix for a nonirreducible Markov chain ⋮ A Performance Comparison of Density-of-States Methods ⋮ Analysis of a finite buffer variable batch service queue with batch Markovian arrival process and server's vacation ⋮ Entrywise relative perturbation bounds for exponentials of essentially non-negative matrices ⋮ Further Comparisons of Direct Methods for Computing Stationary Distributions of Markov Chains ⋮ The infinite-buffer single server queue with a variant of multiple vacation policy and batch Markovian arrival process ⋮ Steady state analysis of level dependent quasi-birth-and-death processes with catastrophes ⋮ Blockwise perturbation theory for nearly uncoupled Markov chains and its application ⋮ Loss probability in an overloaded discrete-time \(GI/G/1/K\) system with very large \(K\). ⋮ Componentwise bounds for nearly completely decomposable Markov chains using stochastic comparison and reordering ⋮ Analysis of stationary discrete-time \(GI/D-MSP/1\) queue with finite and infinite buffers ⋮ Fluid Flow Models and Queues—A Connection by Stochastic Coupling ⋮ Computing singular values of diagonally dominant matrices to high relative accuracy ⋮ Solving matrix polynomial equations arising in queueing problems ⋮ Accurate numerical solution for structured \(M\)-matrix algebraic Riccati equations ⋮ The Markov chain tree theorem in commutative semirings and the state reduction algorithm in commutative semifields ⋮ Iterant recombination with one-norm minimization for multilevel Markov chain algorithms via the ellipsoid method ⋮ AnRG-Factorization Approach for a BMAP/M/1 Generalized Processor-Sharing Queue ⋮ Finite-Buffer Bulk Service Queue Under Markovian Service Process:GI/MSP(a,b)/1/N ⋮ Optimizing steady state Markov chains by state reduction ⋮ Efficient computational analysis of non-exhaustive service vacation queues: \(BMAP/R/1/N(\infty)\) under gated-limited discipline ⋮ On the optimal control of loss probability and profit in a \(GI /C\)-\(BMSP /1/N\) queueing system ⋮ A simple analysis of system characteristics in the batch service queue with infinite-buffer and Markovian service process using the roots method:GI/C-MSP(a,b)/1/∞ ⋮ Queue-length, waiting-time and service batch size analysis for the discrete-time \(GI/D-MSP^{\text{(a,b)}}/1/\infty\) queueing system ⋮ Case for First Courses on Finite Markov Chain Modeling to Include Sojourn Time Cycle Chart ⋮ Infinite level-dependent QBD processes and matrix-analytic solutions for stochastic chemical kinetics ⋮ Accurate numerical solution for shifted \(M\)-matrix algebraic Riccati equations ⋮ Highly accurate doubling algorithm for quadratic matrix equation from quasi-birth-and-death process ⋮ Parallel computing for Markov chains with islands and ports ⋮ The state reduction and related algorithms and their applications to the study of Markov chains, graph theory, and the optimal stopping problem ⋮ Analysis of nonpreemptive priority queues with multiple servers and two priority classes ⋮ Highly Accurate Latouche-Ramaswami Logarithmic Reduction Algorithm for Quasi-Birth-and-Death Process ⋮ Analyses of an M/M/N queue with servers' vacations ⋮ State reduction in a Markov decision process ⋮ Accurate calculations of stationary distributions and mean first passage times in Markov renewal processes and Markov chains
This page was built for publication: Regenerative Analysis and Steady State Distributions for Markov Chains
