Some properties of Rényi entropy over countably infinite alphabets

DOI10.1134/S0032946013020014zbMath1290.94023arXiv1106.5130OpenAlexW1987459102MaRDI QIDQ383169

Vojin Šenk, Mladen Kovačević, Ivan Stanojević

Publication date: 25 November 2013

Published in: Problems of Information Transmission (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1106.5130

zbMATH Keywords

Shannon entropyRényi entropiescountably infinite alphabetRényi critical exponent, Rényi region of convergence

Mathematics Subject Classification ID

Measures of information, entropy (94A17) Information theory (general) (94A15)

Related Items

On Partial Monotonic Behaviour of Past Entropy and Convolution of Extropy

Cites Work

• Unnamed Item
• Unnamed Item
• The world according to Rényi: Thermodynamics of multifractal systems
• Rényi entropy rate for Gaussian processes
• Some properties of Rényi entropy and Rényi entropy rate
• Information theory and the limit-theorem for Markov chains and processes with a countable infinity of states
• On a coding theorem connected with Rényi's entropy
• Renyi's entropy and the probability of error
• Generalized cutoff rates and Renyi's information measures
• On the Discontinuity of the Shannon Information Measures
• Coding on Countably Infinite Alphabets
• Universal Coding on Infinite Alphabets: Exponentially Decreasing Envelopes
• On Information Divergence Measures and a Unified Typicality
• The Interplay Between Entropy and Variational Distance
• On the Interplay Between Conditional Entropy and Error Probability
• A coding theorem and Rényi's entropy
• On the Foundations of Information Theory