An adaptive Polyak heavy-ball method
type: Item
instance of: scholarly article
title: An adaptive Polyak heavy-ball method
author: Yanyan Li
published in: Machine Learning
publication date: 2022-11-28T00:00:00Z
Mathematics Subject Classification ID: 68T05
zbMATH DE Number: 7624272
zbMATH Keywords: Polyak heavy-ball
zbMATH Keywords: gradient descent
zbMATH Keywords: global convergence
cites work: ImageNet
cites work: Automated adaptation strategies for stream learning
cites work: First-Order Methods in Optimization
cites work: A New Class of Incremental Gradient Methods for Least Squares Problems
cites work: Q5396673
cites work: Stochastic heavy ball
cites work: Stochastic First- and Zeroth-Order Methods for Nonconvex Stochastic Programming
cites work: Accelerated gradient methods for nonconvex nonlinear and stochastic programming
cites work: A literature survey of benchmark functions for global optimisation problems
cites work: Analysis and Design of Optimization Algorithms via Integral Quadratic Constraints
cites work: An Accelerated Randomized Proximal Coordinate Gradient Method and its Application to Regularized Empirical Risk Minimization
cites work: Momentum and stochastic momentum for stochastic gradient, Newton, proximal point and subspace descent methods
cites work: Introductory lectures on convex optimization. A basic course.
cites work: Stochastic gradient descent with Polyak's learning rate
cites work: iPiasco: inertial proximal algorithm for strongly convex optimization
cites work: iPiano: inertial proximal algorithm for nonconvex optimization
cites work: Some methods of speeding up the convergence of iteration methods
cites work: Q4633074
cites work: A Stochastic Approximation Method
cites work: Q5149016
cites work: Heavy-ball method in nonconvex optimization problems
describes a project that uses: ImageNet
describes a project that uses: MNIST
describes a project that uses: Adam
describes a project that uses: ADADELTA
describes a project that uses: AdaGrad
describes a project that uses: PyTorch
describes a project that uses: iPiano
describes a project that uses: CIFAR
describes a project that uses: iPiasco
MaRDI profile type: Publication
full work available at URL: s10994-022-06215-7
OpenAlex ID: W4285801387
Wikidata QID: Q114224928
DOI: 10.1007/S10994-022-06215-7
description: scientific article; zbMATH DE number 7624272