Dual bounds on the equilibrium distribution of a finite Markov chain (Q1092519)
From MaRDI portal
| This is the item page for this Wikibase entity, intended for internal use and editing purposes. Please use this page instead for the normal view: Dual bounds on the equilibrium distribution of a finite Markov chain |
scientific article; zbMATH DE number 4020132
| Language | Label | Description | Also known as |
|---|---|---|---|
| English | Dual bounds on the equilibrium distribution of a finite Markov chain |
scientific article; zbMATH DE number 4020132 |
Statements
Dual bounds on the equilibrium distribution of a finite Markov chain (English)
0 references
1987
0 references
Consider a stationary finite Markov chain with states numbered 1,2,...,N and transition probability matrix \(P=[P_{ij}]\), \(1\leq i\), \(j\leq N\), \(P_{ij}\geq 0\), \(\sum^{N}_{j=1}P_{ij}=1\). The author assumes that P is both unichained and aperiodic and gives sharp upper and lower bounds for the equilibrium state probabilities \(\pi_ k\) (1\(\leq k\leq N)\) of P, along with an iterative scheme which moves the bounds monotonically and geometrically inward to \(\pi_ k.\) The present bounds generalize a result of \textit{J. G. Kemeny} and \textit{J. L. Snell} [Finite Markov Chains (p.173) (1960; Zbl 0089.137)]. It may be noted that they have the advantage of being tight for small values of n, thereby reducing computational effort, but they have the disadvantage of working for only one choice of k at a time, so that bounding the entire equilibrium distribution requires N-fold effort.
0 references
stationary finite Markov chain
0 references
sharp upper and lower bounds for the equilibrium state probabilities
0 references
0 references