On the Influence of Momentum Acceleration on Online Learning

zbMath1392.68372arXiv1603.04136MaRDI QIDQ2834537

Ali H. Sayed, Kun Yuan, Bicheng Ying

Publication date: 22 November 2016

Full work available at URL: https://arxiv.org/abs/1603.04136

zbMATH Keywords

convergence rateonline learningNesterov's methodstochastic gradientheavy-ball methodmomentum accelerationmean-square-error analysis

Mathematics Subject Classification ID

Numerical optimization and variational techniques (65K10) Learning and adaptive systems in artificial intelligence (68T05) Stochastic programming (90C15)

Related Items (2)

Online Smoothing for Diffusion Processes Observed with Noise ⋮ An overview of stochastic quasi-Newton methods for large-scale machine learning

Uses Software

• AdaGrad

This page was built for publication: On the Influence of Momentum Acceleration on Online Learning