The Asymptotic Equipartition Property for a Nonhomogeneous Markov Information Source

DOI10.1017/S0269964800005350zbMath0987.94012MaRDI QIDQ4950731

Wei-guo Yang

Publication date: 9 April 2000

Published in: Probability in the Engineering and Informational Sciences (Search for Journal in Brave)

zbMATH Keywords

limit theoremmartingale difference sequenceasymptotic equipartition propertyrelative entropy densitynonhomogeneous Markov information source

Mathematics Subject Classification ID

Applications of Markov chains and discrete-time Markov processes on general state spaces (social mobility, learning theory, industrial processes, etc.) (60J20) Martingales with continuous parameter (60G44) Information theory (general) (94A15)

Related Items (7)

SOME LIMIT THEOREMS OF DELAYED AVERAGES FOR COUNTABLE NONHOMOGENEOUS MARKOV CHAINS ⋮ THE STRONG LIMIT THEOREM FOR RELATIVE ENTROPY DENSITY RATES BETWEEN TWO ASYMPTOTICALLY CIRCULAR MARKOV CHAINS ⋮ The generalized entropy ergodic theorem for nonhomogeneous Markov chains ⋮ Strong law of large numbers for generalized sample relative entropy of non homogeneous Markov chains ⋮ The strong law of large numbers for moving average of continuous state nonhomogeneous Markov chains ⋮ Markov approximation and the generalized entropy ergodic theorem for non-null stationary process ⋮ The generalized entropy ergodic theorem for nonhomogeneous bifurcating Markov chains indexed by a binary tree

Cites Work

• A Mathematical Theory of Communication
• The strong ergodic theorem for densities: Generalized Shannon-McMillan- Breiman theorem
• A simple proof of the Moy-Perez generalization of the Shannon-McMillan theorem
• The Individual Ergodic Theorem of Information Theory
• A Note on the Ergodic Theorem of Information Theory
• The Basic Theorems of Information Theory

This page was built for publication: The Asymptotic Equipartition Property for a Nonhomogeneous Markov Information Source