An information-geometric approach to a theory of pragmatic structuring

DOI10.1214/aop/1020107773zbMath1010.62007OpenAlexW2013941842MaRDI QIDQ1872264

Nihat Ay

Publication date: 6 May 2003

Published in: The Annals of Probability (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1214/aop/1020107773

zbMATH Keywords

mutual informationexponential familyKullback-Leibler divergenceinformation geometrystochastic interactioninfomax principle

Mathematics Subject Classification ID

Random fields; image analysis (62M40) Learning and adaptive systems in artificial intelligence (68T05) Neural biology (92C20) Neural networks for/in biological studies, artificial life and related topics (92B20) Statistical aspects of information-theoretic topics (62B10) Neural nets and related approaches to inference from stochastic processes (62M45)

Related Items (19)

Information geometry on complexity and stochastic interaction ⋮ Locality of Global Stochastic Interaction in Directed Acyclic Networks ⋮ On limiting towards the boundaries of exponential families ⋮ Information geometric methods for complexity ⋮ Unnamed Item ⋮ Entropic Trust Region for Densest Crystallographic Symmetry Group Packings ⋮ Optimally approximating exponential families ⋮ Quantum convex support ⋮ Continuity of the maximum-entropy inference ⋮ Unnamed Item ⋮ Unnamed Item ⋮ Maximizing the Divergence from a Hierarchical Model of Quantum States ⋮ Information and complexity, or: where is the information? ⋮ Maximizing the Bregman divergence from a Bregman family ⋮ Factorized mutual information maximization ⋮ On the entropy of couplings ⋮ A geometric approach to complexity ⋮ Information geometry and sufficient statistics ⋮ Entropy distance: New quantum phenomena

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• A Mathematical Theory of Communication
• Completely integrable gradient systems on the manifolds of Gaussian and multinomial distributions
• I-divergence geometry of probability distributions and minimization problems
• Gradient systems in view of information geometry
• Information geometry of estimating functions in semi-parametric statistical models
• Information dynamics and open systems. Classical and quantum approach
• Detecting higher-order interactions among the spiking events in a group of neurons
• Differential-geometrical methods in statistics
• Information Theory and Statistical Mechanics
• Variational Analysis
• Information geometry on hierarchy of probability distributions
• On the Uniform Convergence of Relative Frequencies of Events to Their Probabilities
• On Information and Sufficiency

This page was built for publication: An information-geometric approach to a theory of pragmatic structuring