Scientific Applications: An algorithm for identifying the ergodic subchains and transient states of a stochastic matrix
From MaRDI portal
Publication:5567482
DOI10.1145/364063.364082zbMath0177.45701OpenAlexW2027923657MaRDI QIDQ5567482
Publication date: 1968
Published in: Communications of the ACM (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.1145/364063.364082
Related Items
A non-recursive algorithm for classifying the states of a finite Markov chain ⋮ An improved algorithm for solving communicating average reward Markov decision processes ⋮ Markov Reward Models and Markov Decision Processes in Discrete and Continuous Time: Performance Evaluation and Optimization ⋮ A value-iteration scheme for undiscounted multichain Markov renewal programs ⋮ Deterministic discrete dynamic programming with discount factor greater than one: Some further results and algorithms ⋮ On diagonal dominance in linear complementarity ⋮ Analysis of Markov Influence Graphs ⋮ Bayesian selection probability estimation for probabilistic Boolean networks ⋮ Policy improvement for perfect information additive reward and additive transition stochastic games with discounted and average payoffs ⋮ The jump start power method: a new approach for computing the ergodic projector of a finite Markov chain ⋮ Stochastic control of paging in a two-level computer memory ⋮ The performance evaluation of a multi-stage JIT production system with stochastic demand and production capacities ⋮ Applications of linear programming theory to existence and uniqueness classes for the Cauchy problem ⋮ Computing a graph's period quadratically by node condensation ⋮ A dynamic programming approach for finite Markov processes and algorithms for the calculation of the limit matrix in Markov chains ⋮ Totally expanding multiplicative systems
