The dynamics of representation learning in shallow, non-linear autoencoders

DOI10.1088/1742-5468/ad01afMaRDI QIDQ6611448

Sebastian Goldt, Maria Refinetti

Publication date: 26 September 2024

Published in: Journal of Statistical Mechanics: Theory and Experiment (Search for Journal in Brave)

zbMATH Keywords

learning theorynonlinear dynamicsmachine learning

Mathematics Subject Classification ID

Statistical mechanics, structure of matter (82-XX)

Cites Work

• Unnamed Item
• Auto-association by multilayer perceptrons and singular value decomposition
• A simplified neuron model as a principal component analyzer
• The generalised product moment distribution in samples from a normal multivariate population.
• The approximation of one matrix by another of lower rank.
• On-line backpropagation in two-layered neural networks
• The dynamics of on-line principal component analysis
• Optimization of on-line principal component analysis
• The Generalization Error of Random Features Regression: Precise Asymptotics and the Double Descent Curve
• A mathematical theory of semantic development in deep neural networks
• DISTRIBUTION OF EIGENVALUES FOR SOME SETS OF RANDOM MATRICES
• Dynamics of stochastic gradient descent for two-layer neural networks in the teacher–student setup*

This page was built for publication: The dynamics of representation learning in shallow, non-linear autoencoders