Statistical estimation of the Shannon entropy

DOI10.1007/s10114-018-7440-zzbMath1411.60049arXiv1801.02050OpenAlexW2962687584MaRDI QIDQ1734902

Denis Dimitrov, Alexander V. Bulinski

Publication date: 27 March 2019

Published in: Acta Mathematica Sinica. English Series (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1801.02050

zbMATH Keywords

Shannon differential entropyGaussian vectorsasymptotic unbiasedness and \(L^2\)-consistencyHardy-Littlewood maximal function analoguesKozachenko-Leonenko estimates

Mathematics Subject Classification ID

Estimation in multivariate analysis (62H12) Asymptotic properties of nonparametric inference (62G20) (L^p)-limit theorems (60F25)

Related Items (7)

Keyfitz entropy: investigating some mathematical properties and its application for estimating survival function in life table ⋮ Entropy-based test for generalised Gaussian distributions ⋮ Detecting anomalies in fibre systems using 3-dimensional image data ⋮ Nonparametric estimation of quantile-based entropy function ⋮ Statistical estimation of mutual information for mixed model ⋮ Statistical estimation of conditional Shannon entropy ⋮ The entropy based goodness of fit tests for generalized von Mises-Fisher distributions and beyond

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• A Mathematical Theory of Communication
• Mutual information is copula entropy
• On the Kozachenko-Leonenko entropy estimator
• Entropy: the Markov ordering approach
• A class of Rényi information estimators for multidimensional densities
• Sample estimate of the entropy of a random vector
• Entropy-based inhomogeneity detection in fiber materials
• Efficient estimation of integral functionals of a density
• A computationally efficient estimator for mutual information
• Foundations of Modern Probability
• Asymptotic moments of near–neighbour distance distributions
• The different paths to entropy
• Ensemble Estimators for Multivariate Entropy Estimation
• Real Analysis
• Probability-1

This page was built for publication: Statistical estimation of the Shannon entropy