Minimum mutual information and non-Gaussianity through the maximum entropy method: theory and properties

DOI10.3390/e14061103zbMath1314.94031OpenAlexW2049420890WikidataQ64391355 ScholiaQ64391355MaRDI QIDQ406088

Carlos A. L. Pires, Rui A. P. Perdigão

Publication date: 8 September 2014

Published in: Entropy (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.3390/e14061103

zbMATH Keywords

mutual informationmaximum entropy distributionsnon-gaussian noisenon-gaussianity

Mathematics Subject Classification ID

Measures of information, entropy (94A17) Statistical aspects of information-theoretic topics (62B10)

Related Items

Independent subspace analysis of the sea surface temperature variability: non-Gaussian sources and sensitivity to sampling and dimensionality, Minimum mutual information and non-Gaussianity through the maximum entropy method: theory and properties, Asymptotic behavior of the maximum entropy routing in computer networks, Minimum mutual information and non-Gaussianity through the maximum entropy method: estimation from finite samples

Uses Software

• Mathematica

Cites Work

• Minimum mutual information and non-Gaussianity through the maximum entropy method: theory and properties
• Some numerical experiments with variable-storage quasi-Newton algorithms
• Multivariate maximum entropy identification, transformation, and dependence
• The multidimensional maximum entropy moment problem: a review on numerical methods
• The multidimensional moment-constrained maximum entropy problem: A BFGS algorithm with constraint scaling
• Independent component analysis, a new concept?
• Entropy densities with an application to autoregressive conditional skewness and kurtosis.
• Constructing multivariate distributions with specific marginal distributions
• An improved algorithm for the multidimensional moment-constrained maximum entropy problem
• Expressions for Rényi and Shannon entropies for bivariate distributions
• A mathematical framework for quantifying predictability through relative entropy
• Mutual Information and Minimum Mean-Square Error in Gaussian Channels
• Independent coordinates for strange attractors from mutual information
• A Convergent Iterative Procedure for Constructing Bivariate Distributions
• Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy
• Asymptotic Statistics
• Entropy expressions for multivariate continuous distributions
• Estimation in Gaussian Noise: Properties of the Minimum Mean-Square Error
• Edgeworth Approximation of Multivariate Differential Entropy