Entropy and the Law of Small Numbers

DOI10.1109/TIT.2004.840861zbMath1297.94016arXivmath/0211020OpenAlexW3106311672WikidataQ60522099 ScholiaQ60522099MaRDI QIDQ3547166

Ioannis Kontoyiannis, Peter Harremoës, Oliver Johnson

Publication date: 21 December 2008

Published in: IEEE Transactions on Information Theory (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/math/0211020

zbMATH Keywords

total variationlogarithmic Sobolev inequalityFisher informationPoisson approximationsubadditivitylaw of small numbersconvergence in relative entropy

Mathematics Subject Classification ID

Inequalities; stochastic orderings (60E15) Measures of information, entropy (94A17) Information theory (general) (94A15) Statistical aspects of information-theoretic topics (62B10)

Related Items (19)

Discrete versions of the transport equation and the Shepp-Olkin conjecture ⋮ Log-concavity, ultra-log-concavity, and a maximum entropy property of discrete compound Poisson measures ⋮ Log-concavity and the maximum entropy property of the Poisson distribution ⋮ Information in Probability: Another Information-Theoretic Proof of a Finite de Finetti Theorem ⋮ A Charlier-Parseval approach to Poisson approximation and its applications ⋮ Entropy and the discrete central limit theorem ⋮ The entropic Erdős-Kac limit theorem ⋮ Information-theoretic convergence of extreme values to the Gumbel distribution ⋮ A discrete log-Sobolev inequality under a Bakry-Émery type condition ⋮ Improved lower bounds on the total variation distance for the Poisson approximation ⋮ Estimation on reliability models of bearing failure data ⋮ Log-concavity and strong log-concavity: a review ⋮ Stam inequality on \(\mathbb Z_n\) ⋮ Convergence of Markov chains in information divergence ⋮ Majorization and Rényi entropy inequalities via Sperner theory ⋮ Strong Log-concavity is Preserved by Convolution ⋮ Poisson approximation ⋮ An information-theoretic proof of a finite de Finetti theorem ⋮ Entropy Inequalities for Sums in Prime Cyclic Groups

This page was built for publication: Entropy and the Law of Small Numbers