Alternating cyclic vector extrapolation technique for accelerating nonlinear optimization algorithms and fixed-point mapping applications

DOI10.1016/j.cam.2023.115607MaRDI QIDQ6126026

Nicolas Lepage-Saucier

Publication date: 9 April 2024

Published in: Journal of Computational and Applied Mathematics (Search for Journal in Brave)

zbMATH Keywords

fixed pointnonlinear optimizationextrapolation methodgradient descentmapping algorithmacceleration scheme

Mathematics Subject Classification ID

Nonlinear programming (90C30) Numerical optimization and variational techniques (65K10) Iterative procedures involving nonlinear operators (47J25) Extrapolation to the limit, deferred corrections (65B05)

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• OLS with multiple high dimensional category variables
• Damped Anderson Acceleration With Restarts and Monotonicity Control for Accelerating EM and EM-like Algorithms
• A quasi-Newton acceleration for high-dimensional optimization algorithms
• On the limited memory BFGS method for large scale optimization
• A comparison of algorithms for fitting the PARAFAC model
• Acceleration schemes for the method of alternating projections
• Vector extrapolation methods. Applications and numerical comparison
• Iterative residual-based vector methods to accelerate fixed point iterations
• A simple extrapolation method for clustered eigenvalues
• A family of spectral gradient methods for optimization
• Minimization of functions having Lipschitz continuous first partial derivatives
• New iterative schemes for nonlinear fixed point problems, with applications to problems with bifurcations and incomplete-data problems
• On rings of operators. Reduction theory
• A flexible, computationally efficient method for fitting the proportional hazards model to interval-censored data
• MM Optimization Algorithms
• A Nonlinear GMRES Optimization Algorithm for Canonical Tensor Decomposition
• Julia: A Fresh Approach to Numerical Computing
• KSSOLV—a MATLAB toolbox for solving the Kohn-Sham equations
• LSMR: An Iterative Algorithm for Sparse Least-Squares Problems
• Objective acceleration for unconstrained optimization
• Algorithm 851
• Simple and Globally Convergent Methods for Accelerating the Convergence of Any EM Algorithm
• GMRES: A Generalized Minimal Residual Algorithm for Solving Nonsymmetric Linear Systems
• Acceleration of vector sequences by multi-dimensional Δ2 methods
• Two-Point Step Size Gradient Methods
• Seasonal Adjustment of Economic Time Series and Multiple Regression Analysis
• Nonlinear hybrid procedures and fixed point iterations
• Gradient Method with Retards and Generalizations
• CUTE
• Shanks Sequence Transformations and Anderson Acceleration
• A Nonmonotone Line Search Technique and Its Application to Unconstrained Optimization
• Extrapolation and Rational Approximation
• The Limited Memory Conjugate Gradient Method
• Iterative Procedures for Nonlinear Integral Equations
• Calculating the Singular Values and Pseudo-Inverse of a Matrix
• Accelerating the Convergence of Matrix Iterative Processes
• A version of the Aitken accelerator for computer iteration
• Functional Operators (AM-21), Volume 1
• Benchmarking optimization software with performance profiles.
• Relaxed steepest descent and Cauchy-Barzilai-Borwein method