Results on limiting sets of Markov set chains
type: Item
instance of: scholarly article
title: Results on limiting sets of Markov set chains
zbMATH Open document ID: 0792.60062
DOI: 10.1016/0024-3795(93)90261-L
author: Darald J. Hartfiel
published in: Linear Algebra and its Applications
publication date: 1994-07-24T00:00:00Z
review text: Let \(K\) denote a non-empty compact set of \((n \times n)\) stochastic matrices. Let \(S_ 0\) be a compact set of \(1 \times n\) stochastic vectors and define recursively for \(k \geq 1\), \(S_ k=S_{k-1} A=\{xA:x \in S_{k-1}\) and \(A \in K\}\). \(\{S_ k\}\), \(k \geq 0\), is called a Markov set chain. The coefficient of ergodicity \(\tau_ 1(A)\) for any stochastic \(A\) is defined by \(\tau_ 1(A)=\sup \{ \| \delta A \|_ 1\), \(\| \delta \|_ 1=1\), \(\delta{\underset\sim 1}=0\}\). This satisfies \(\tau_ 1(A) \leq 1\) and is simply expressed in terms of the entries of \(A\) [reviewer, Nonnegative matrices and Markov chains (1981; Zbl 0471.60001)]. Put \(\overline \tau_ 1=\max_{A \in K} \tau_ 1(A)\). Define diameter for a compact set \(G\) of stochastic matrices by \(d(G)=\max_{A,B \in G} \| A-B \|_ 1\). It is known [reviewer, Stat. Probab. Lett. 2, 159-163 (1984; Zbl 0541.15009)] that if \(\overline \tau_ 1<1\), then \(\lim_{k \to \infty}S_ k\) exists, in the sense of convergence in the Hausdorff metric \(\Delta\) on compact sets; denote the limiting set by \(S_ \infty\). In this paper the author shows further that if \(\overline \tau_ 1<1\), then \(d(S_ \infty) \leq (1-\overline \tau_ 1)^{-1}d(K)\). Further, if \(K'\) is any other compact set of stochastic matrices, and \(\{S_ k'\}\), \(k \geq 0\), is the corresponding Markov set chain, with \(\overline \tau_ 1'<1\), then \(\Delta(S_ \infty,S_ \infty') \leq (1-\overline \tau_ 1)^{-1} \Delta (K,K')\). In the sense that \((1-\overline \tau_ 1)^{-1}\) gives a bound on the magnification error \(\Delta(S_ \infty, S_ \infty')/ \Delta(K,K')\), it is a condition number. This last result in a simpler setting occurs in articles of the reviewer [for example: Adv. Appl. Probab. 20, No. 1, 228-230 (1988; Zbl 0645.60070)].
reviewed by: Eugene Seneta
Mathematics Subject Classification ID: 60J10
Mathematics Subject Classification ID: 15B51
zbMATH DE Number: 519694
zbMATH Keywords: stochastic matrices
zbMATH Keywords: coefficient of ergodicity
zbMATH Keywords: Hausdorff metric
MaRDI profile type: Publication
cites work: Q5722776
cites work: On the Limiting Set of Stochastic Products xA 1 ⋅A k
cites work: Q5643915
cites work: Upper bounds on the maximum modulus of subdominant eigenvalues of nonnegative matrices
cites work: On the limiting set of nonnegative matrix products
cites work: Non-negative matrices and Markov chains. 2nd ed
cites work: A functional form for a particular coefficient of ergodicity
cites work: Coefficients of ergodicity with respect to vector norms
Wikidata QID: Q126657923
Recommended article: Sequential limits in Markov set-chains
Recommended article: Cyclic markov set-chains
Recommended article: Coefficients of ergodicity for imprimitive matrices
Recommended article: A limit theorem for sets of stochastic matrices.
Recommended article: A characterization of Dobrushin's coefficient of ergodicity
Recommended article: Convergence of inhomogeneous products of matrices and coefficients of ergodicity
Recommended article: Coefficients of ergodicity generated by non-symmetrical vector norms
Recommended article: Q4273568
description: scientific article; zbMATH DE number 519694