Stationary distributions and mean first passage times of perturbed Markov chains
From MaRDI portal
Publication:2575710
DOI10.1016/j.laa.2005.08.005zbMath1126.60055OpenAlexW2129842602MaRDI QIDQ2575710
Publication date: 6 December 2005
Published in: Linear Algebra and its Applications (Search for Journal in Brave)
Full work available at URL: http://hdl.handle.net/10179/4371
Numerical solutions to overdetermined systems, pseudoinverses (65F20) Markov chains (discrete-time Markov processes on discrete state spaces) (60J10) Applications of Markov chains and discrete-time Markov processes on general state spaces (social mobility, learning theory, industrial processes, etc.) (60J20)
Related Items
On the long-run sensitivity of probabilistic Boolean networks, Perturbation analysis for continuous-time Markov chains, GENERATION OF STATIONARY CONTROL POLICIES WITH BEST EXPECTED PERFORMANCE FOR A FAMILY OF MARKOV CHAINS, On transition matrices of Markov chains corresponding to Hamiltonian cycles, Acute perturbation of the group inverse, A stochastic method for exploiting outranking relations in multicriteria choice problems, Sensitivity analysis of discrete Markov chains via matrix calculus, Reward algorithms for semi-Markov processes, Asymptotic Expansions for Stationary Distributions of Perturbed Semi-Markov Processes, Unnamed Item, Analysis of Markov Influence Graphs, Generalized inverses of Markovian kernels in terms of properties of the Markov chain, Variances of first passage times in a Markov chain with applications to mixing times, Perturbation analysis of continuous‐time absorbing Markov chains, Minimising the largest mean first passage time of a Markov chain: the influence of directed graphs, Stationary and structural control in gene regulatory networks: basic concepts, On the Variances and Convariances of the Duration State Sizes of Semi-Markov Systems, New perturbation bounds for denumerable Markov chains, Mixing times with applications to perturbed Markov chains, Error bounds for augmented truncation approximations of Markov chains via the perturbation method, Sharp Entrywise Perturbation Bounds for Markov Chains
Cites Work
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Sensitivity of the stationary distribution vector for an ergodic Markov chain
- Stationary distributions of perturbed Markov chains
- Sensitivity to perturbation of the stationary distribution: Some refinements
- Characterizations of generalized inverses associated with Markovian kernels
- Generalized inverses and their application to applied probability problems
- Perturbation results for nearly uncoupled Markov chains with applications to iterative methods
- Entrywise perturbation theory and error analysis for Markov chains
- A note on entrywise perturbation theory for Markov chains
- Applications of Paz's inequality to perturbation bounds for Markov chains
- Perturbation of null spaces with application to the eigenvalue problem and generalized inverses
- A direct projection method for Markov chains
- Improved bounds for a condition number for Markov chains
- Markov chain sensitivity measured by mean first passage times
- Sensitivity of finite Markov chains under perturbation
- Iterative aggregation/disaggregation methods for computing some characteristics of Markov chains. II: Fast convergence
- Blockwise perturbation theory for block \(p\)-cyclic stochastic matrices
- Stable Computation with the Fundamental Matrix of a Markov Chain
- Recursive Algorithm for the Fundamental/Group Inverse Matrix of a Markov Chain from an Explicit Formula
- On a Question Concerning Condition Numbers for Markov Chains
- Perturbation of Markov Chains
- Perturbation of the stationary distribution measured by ergodicity coefficients
- Finite Continuous Time Markov Chains
- Updating finite markov chains by using techniques of group matrix inversion
- The Condition of a Finite Markov Chain and Perturbation Bounds for the Limiting Probabilities
- Numerical Solution of Linear Equations Arising in Markov Chain Models
- The Role of the Group Generalized Inverse in the Theory of Finite Markov Chains
- Computation of the stationary distribution of a markov chain
- Sensitivity of the Stationary Distribution of a Markov Chain
- Uniform Stability of Markov Chains
- Perturbed Markov chains
- A divide and conquer approach to computing the mean first passage matrix for Markov chains via Perron complement reductions
- Accurate Computation of the Fundamental Matrix of a Markov Chain
- Perturbation bounds for the stationary probabilities of a finite Markov chain
- On the stability of the computation of the stationary probabilities of Markov chains using Perron complements
- On the moments of Markov renewal processes
- Perturbation theory and finite Markov chains
- Blockwise perturbation theory for nearly uncoupled Markov chains and its application
- Comparison of perturbation bounds for the stationary distribution of a Markov chain