Noise-induced degeneration in online learning

DOI10.1016/j.physd.2021.133095OpenAlexW3217509189MaRDI QIDQ2077851

Akio Fujiwara, Yuzuru Sato, Daiji Tsutsui

Publication date: 22 February 2022

Published in: Physica D (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/2008.10498

zbMATH Keywords

random dynamical systemsonline learningnoise-induced phenomenaplateau phenomena

Mathematics Subject Classification ID

Biology and other natural sciences (92-XX) Computer science (68-XX)

Cites Work

• Stochastic climate dynamics: random attractors and time-dependent invariant measures
• On the concept of attractor
• On-line learning of a mixture-of-experts neural network
• Flat Minima
• On-line backpropagation in two-layered neural networks
• Minimal attractors and bifurcations of random dynamical systems
• Learning by on-line gradient descent
• Center Manifold Analysis of Plateau Phenomena Caused by Degeneration of Three-Layer Perceptron
• Dynamics of Learning in MLP: Natural Gradient and Singularity Revisited
• Dynamics of Learning Near Singularities in Layered Networks
• New Classes of Synchronous Codes
• A Stochastic Approximation Method
• Approximation by superpositions of a sigmoidal function
• Unnamed Item

This page was built for publication: Noise-induced degeneration in online learning