Direct nonlinear acceleration

DOI10.1016/j.ejco.2022.100047zbMath1530.90074arXiv1905.11692OpenAlexW2946865834MaRDI QIDQ6114957

Yunming Xiao, Peter Richtárik, Aritra Dutta, El Houcine Bergou, Marco Canini

Publication date: 12 July 2023

Published in: EURO Journal on Computational Optimization (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1905.11692

zbMATH Keywords

convex optimizationtraining of neural networksvector sequence extrapolation

Mathematics Subject Classification ID

Artificial neural networks and deep learning (68T07) Numerical mathematical programming methods (65K05) Convex programming (90C25) Nonlinear programming (90C30) Learning and adaptive systems in artificial intelligence (68T05)

Cites Work

• Unnamed Item
• Unnamed Item
• A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
• Gradient methods for minimizing composite functions
• Chebyshev semi-iterative methods, successive overrelaxation iterative methods, and second order Richardson iterative methods. I, II
• Krylov subspace acceleration for nonlinear multigrid schemes
• Steepest descent preconditioning for nonlinear GMRES optimization
• Two classes of multisecant methods for nonlinear acceleration
• Anderson Acceleration for Fixed-Point Iterations
• Objective acceleration for unconstrained optimization
• A Polynomial Extrapolation Method for Finding Limits and Antilimits of Vector Sequences
• Shanks Sequence Transformations and Anderson Acceleration
• Linear Coupling: An Ultimate Unification of Gradient and Mirror Descent
• On the Asymptotic Linear Convergence Speed of Anderson Acceleration, Nesterov Acceleration, and Nonlinear GMRES
• Numerical methods for nonlinear equations
• Convergence Analysis for Anderson Acceleration
• Some methods of speeding up the convergence of iteration methods
• Iterative Procedures for Nonlinear Integral Equations
• On a Device for Computing the e m (S n ) Transformation

This page was built for publication: Direct nonlinear acceleration