Some properties of Rényi entropy and Rényi entropy rate

DOI10.1016/j.ins.2009.03.002zbMath1169.94331OpenAlexW1987805576MaRDI QIDQ2390363

Einollah Pasha, Leila Golshani, Gholam Hossein Yari

Publication date: 22 July 2009

Published in: Information Sciences (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1016/j.ins.2009.03.002

zbMATH Keywords

stationary processShannon entropyRényi entropyRényi entropy ratequasi-linear meanshannon entropy rate

Mathematics Subject Classification ID

Measures of information, entropy (94A17)

Related Items

A NOTE ON RÉNYI'S ENTROPY RATE FOR TIME-INHOMOGENEOUS MARKOV CHAINS ⋮ The conditional average entropies ⋮ Sensitivity analysis for rare events based on Rényi divergence ⋮ Some properties of Rényi entropy over countably infinite alphabets ⋮ Analyzing supersaturated designs with entropic measures ⋮ The Pólya information divergence ⋮ Results on residual Rényi entropy of order statistics and record values ⋮ Divergence statistics for testing uniform association in cross-classifications ⋮ A generalization of Rényi entropy for basic probability assignment ⋮ One-way functions using algorithmic and classical information theories ⋮ Unnamed Item ⋮ Rényi entropy rate for Gaussian processes ⋮ Renyi Entropy of Progressively Censored Data ⋮ Further results on generalized conditional entropies ⋮ Individual attacks with generalized discrimination and inadequacy of some information measures

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• A Mathematical Theory of Communication
• On the entropy of a hidden Markov process
• Robust coding for a class of sources: Applications in control and reliable communication over limited capacity channels
• On the geometry of generalized Gaussian distributions
• Using the Renyi entropy to describe quantum dissipative systems in statistical mechanics
• On Rényi information for ergodic diffusion processes
• On some entropy functionals derived from Rényi information divergence
• Non-negative matrices and Markov chains. 2nd ed
• The world according to Rényi: Thermodynamics of multifractal systems
• Rényi entropy rate for Gaussian processes
• Gelfand-Yaglom-Perez theorem for generalized relative entropy functionals
• Inference Processes for Quantified Predicate Knowledge
• On the Estimation of Differential Entropy From Data Located on Embedded Manifolds
• Spectral Radius and Radius of Convergence
• Renyi's divergence and entropy rates for finite alphabet Markov sources
• Conditional entropies and their relation to entanglement criteria
• Generalized cutoff rates and Renyi's information measures
• The asymptotics of posterior entropy and error probability for Bayesian estimation
• On convergence of information in spaces with infinite invariant measure

This page was built for publication: Some properties of Rényi entropy and Rényi entropy rate