The effective noise of stochastic gradient descent

DOI10.1088/1742-5468/ac841dOpenAlexW4293168170MaRDI QIDQ5043083

Pierfrancesco Urbani, Francesca Mignacco

Publication date: 20 October 2022

Published in: Journal of Statistical Mechanics: Theory and Experiment (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/2112.10852

zbMATH Keywords

learning theorymachine learning

Mathematics Subject Classification ID

Statistical mechanics, structure of matter (82-XX)

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• On the diffusion approximation of nonconvex stochastic gradient descent
• The effective temperature
• A mean field view of the landscape of two-layer neural networks
• The inverse variance–flatness relation in stochastic gradient descent is critical for finding flat minima
• Theory of Simple Glasses
• Out-of-equilibrium dynamical mean-field equations for the perceptron model
• Ridge Regression: Biased Estimation for Nonorthogonal Problems

This page was built for publication: The effective noise of stochastic gradient descent