Information in Infinite Ensembles of Infinitely-Wide Neural Networks
From MaRDI portal
Publication:6329599
arXiv1911.09189MaRDI QIDQ6329599
Author name not available (Why is that?)
Publication date: 20 November 2019
Abstract: In this preliminary work, we study the generalization properties of infinite ensembles of infinitely-wide neural networks. Amazingly, this model family admits tractable calculations for many information-theoretic quantities. We report analytical and empirical investigations in the search for signals that correlate with generalization.
Has companion code repository: https://github.com/ravidziv/info_ntk
This page was built for publication: Information in Infinite Ensembles of Infinitely-Wide Neural Networks
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6329599)
