Non-parametric entropy estimators based on simple linear regression

DOI10.1016/j.csda.2015.03.011zbMath1468.62078OpenAlexW2075015123MaRDI QIDQ1663254

Hideitsu Hino, Kensuke Koshijima, Noboru Murata

Publication date: 21 August 2018

Published in: Computational Statistics and Data Analysis (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1016/j.csda.2015.03.011

zbMATH Keywords

nonparametricentropy estimationsimple linear regression

Mathematics Subject Classification ID

Computational methods for problems pertaining to statistics (62-08) Linear regression; mixed models (62J05) Nonparametric estimation (62G05) Statistical aspects of information-theoretic topics (62B10)

Related Items (1)

Geometry of EM and related iterative algorithms

Uses Software

• KernSmooth
• FastICA

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• A Mathematical Theory of Communication
• Information estimators for weighted observations
• Estimation of entropy and other functionals of a multivariate density
• A class of Rényi information estimators for multidimensional densities
• On powerful distributional tests based on sample spacings
• Density-free convergence properties of various estimators of entropy
• Sample estimate of the entropy of a random vector
• Consistency properties of nearest neighbor density function estimators
• Multivariate k-nearest neighbor density estimates
• Independent component analysis, a new concept?
• Entropy-based sliced inverse regression
• Possible generalization of Boltzmann-Gibbs statistics.
• Multivariate plug-in bandwidth selection
• A Conditional Entropy Minimization Criterion for Dimensionality Reduction and Multiple Kernel Learning
• Entropy-Based Tests of Uniformity
• A nonparametric estimation of the entropy for absolutely continuous distributions (Corresp.)
• 10.1162/jmlr.2003.4.7-8.1271
• A new class of random vector entropy estimators and its applications in testing statistical hypotheses
• Estimation of Entropy and Mutual Information
• A Nonparametric Estimate of a Multivariate Density Function

This page was built for publication: Non-parametric entropy estimators based on simple linear regression