Shannon entropy rate of hidden Markov processes

DOI10.1007/s10955-021-02769-3OpenAlexW3081659665MaRDI QIDQ2034664

Alexandra M. Jurgens, James P. Crutchfield

Publication date: 22 June 2021

Published in: Journal of Statistical Physics (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/2008.12886

zbMATH Keywords

Markov processiterated function systemoptimal predictionShannon entropymixed stateBlackwell measurepredictive feature

Mathematics Subject Classification ID

Theory of computing (68Qxx) Computer science (68-XX) Computability and recursion theory (03Dxx)

Related Items (2)

Optimality and complexity in measured quantum-state stochastic processes ⋮ Topology, convergence, and reconstruction of predictive states

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• A Mathematical Theory of Communication
• Predictive rate-distortion for infinite-order Markov processes
• Exponential bounds for convergence of entropy rate approximations in hidden Markov models satisfying a path-mergeability condition
• On the entropy of a hidden Markov process
• Entropy of hidden Markov processes via cycle expansion
• Time series analysis via mechanistic models
• Invariant measures for Markov processes arising from iterated function systems with place-dependent probabilities
• An alternative derivation of Birkhoff's formula for the contraction coefficient of a positive matrix.
• The calculi of emergence: Computation, dynamics and induction
• Exact complexity: the spectral decomposition of intrinsic computation
• Automata Studies. (AM-34)
• Extensions of Jentzsch's Theorem
• Analyticity of Entropy Rate of Hidden Markov Chains
• Combinatorial foundations of information theory and the calculus of probabilities
• An ergodic theorem for iterated maps
• Approximations for the Entropy for Functions of Markov Chains
• The Contraction Mapping Approach to the Perron-Frobenius Theory: Why Hilbert's Metric?
• Entropy computing via integration over fractal measures
• Spectral simplicity of apparent complexity. II. Exact complexities and complexity spectra
• Hidden Markov processes
• Hidden Markov models for stochastic thermodynamics
• Optimal causal inference: Estimating stored information and approximating causal architecture
• Entropy of a bit-shift channel
• Elements of Information Theory
• Regularities unseen, randomness observed: Levels of entropy convergence
• On Computable Numbers, with an Application to the Entscheidungsproblem
• Computational mechanics: pattern and prediction, structure and simplicity.

This page was built for publication: Shannon entropy rate of hidden Markov processes