Learning and generalization with the information bottleneck

DOI10.1016/j.tcs.2010.04.006zbMath1192.68395OpenAlexW2123469175MaRDI QIDQ982641

Sivan Sabato, Ohad Shamir, Naftali Tishby

Publication date: 7 July 2010

Published in: Theoretical Computer Science (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1016/j.tcs.2010.04.006

zbMATH Keywords

information theorysufficient statisticsstatistical learning theoryinformation bottleneck

Mathematics Subject Classification ID

Computational learning theory (68Q32)

Related Items

Understanding Deep Learning with Statistical Relevance ⋮ The role of mutual information in variational classifiers ⋮ Neural network coding of natural images with applications to pure mathematics ⋮ The Deterministic Information Bottleneck ⋮ Statistical criticality arises in most informative representations ⋮ Maximal relevance and optimal learning machines ⋮ Unnamed Item

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Feature extraction. Foundations and applications. Papers from NIPS 2003 workshop on feature extraction, Whistler, BC, Canada, December 11--13, 2003. With CD-ROM.
• Convergence properties of functional estimates for discrete distributions
• Estimation of Entropy and Mutual Information
• Learning Theory and Kernel Machines
• Information-based clustering
• On Information and Sufficiency