Predictive rate-distortion for infinite-order Markov processes

DOI10.1007/s10955-016-1520-1zbMath1398.60101arXiv1412.2859OpenAlexW2345543116MaRDI QIDQ310017

Sarah E. Marzen, James P. Crutchfield

Publication date: 7 September 2016

Published in: Journal of Statistical Physics (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1412.2859

zbMATH Keywords

computational mechanicscausal statesepsilon-machineinformation bottleneckoptimal causal filteringpredictive rate-distortion

Mathematics Subject Classification ID

Processes in random environments (60K37)

Related Items (5)

Spectral simplicity of apparent complexity. I. The nondiagonalizable metadynamics of prediction ⋮ Correction to: ``Predictive rate-distortion for infinite-order Markov processes ⋮ Topology, convergence, and reconstruction of predictive states ⋮ Shannon entropy rate of hidden Markov processes ⋮ Prediction and dissipation in nonequilibrium molecular sensors: conditionally Markovian channels driven by memoryful environments

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• A Mathematical Theory of Communication
• Information anatomy of stochastic equilibria
• Properties of the statistical complexity functional and partially deterministic HMMs
• Prediction, retrodiction, and the amount of information stored in the present
• Fluctuation spectroscopy
• Bifurcation structure of a class of \(S_N\)-invariant constrained optimization problems
• The calculi of emergence: Computation, dynamics and induction
• Exact complexity: the spectral decomposition of intrinsic computation
• Predictability, Complexity, and Learning
• The Computational Structure of Spike Trains
• Hidden Markov Models for Speech Recognition
• INFORMATION BOTTLENECKS, CAUSAL STATES, AND STATISTICAL RELEVANCE BASES: HOW TO REPRESENT RELEVANT INFORMATION IN MEMORYLESS TRANSDUCTION
• Hidden Markov processes
• A mapping approach to rate-distortion computation and analysis
• Symmetry Breaking in Soft Clustering Decoding of Neural Codes
• Optimal causal inference: Estimating stored information and approximating causal architecture
• Excess entropy in natural language: Present state and perspectives
• Information symmetries in irreversible processes
• Predictive Coding and the Slowness Principle: An Information-Theoretic Approach
• Elements of Information Theory
• Regularities unseen, randomness observed: Levels of entropy convergence
• Computational mechanics: pattern and prediction, structure and simplicity.

This page was built for publication: Predictive rate-distortion for infinite-order Markov processes