Improving “Fast Iterative Shrinkage-Thresholding Algorithm”: Faster, Smarter, and Greedier

DOI10.1137/21M1395685zbMath1492.65163arXiv1811.01430OpenAlexW2990168768MaRDI QIDQ5075693

Tao Luo, Jingwei Liang, Carola-Bibiane Schönlieb

Publication date: 11 May 2022

Published in: SIAM Journal on Scientific Computing (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1811.01430

zbMATH Keywords

adaptive and greedy accelerationfast iterative shrinkage-thresholding algorithm (FISTA)inertial forward-backwardlazy-start strategy

Mathematics Subject Classification ID

Numerical mathematical programming methods (65K05) Convex programming (90C25) Sensitivity, stability, parametric optimization (90C31)

Related Items

Approximation method for monotone inclusion problems in real Banach spaces with applications, ``FISTA in Banach spaces with adaptive discretisations, Computable centering methods for spiraling algorithms and their duals, with motivations from the theory of Lyapunov functions, Fast gradient method for low-rank matrix estimation, A class of modified accelerated proximal gradient methods for nonsmooth and nonconvex minimization problems, A fast inertial primal-dual algorithm to composite optimization models with application to image restoration problems, New proximal type algorithms for convex minimization and its application to image deblurring

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Nonlinear total variation based noise removal algorithms
• A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
• Convergence rates with inexact non-expansive operators
• On the convergence of the iterates of the ``fast iterative shrinkage/thresholding algorithm
• An inertial forward-backward algorithm for monotone inclusions
• Introductory lectures on convex optimization. A basic course.
• Adaptive restart of the optimized gradient method for convex optimization
• Inertial forward-backward algorithms with perturbations: application to Tikhonov regularization
• Convergence of a splitting inertial proximal method for monotone operators
• Convergence rates of forward-Douglas-Rachford splitting method
• Adaptive restart for accelerated gradient schemes
• Fast convergence of inertial dynamics and algorithms with asymptotic vanishing viscosity
• The Rate of Convergence of Nesterov's Accelerated Forward-Backward Method is Actually Faster Than $1/k^2$
• Activity Identification and Local Linear Convergence of Forward--Backward-type Methods
• Robust principal component analysis?
• Splitting Algorithms for the Sum of Two Nonlinear Operators
• Convergence Rates of Inertial Forward-Backward Algorithms
• Inertial, Corrected, Primal-Dual Proximal Splitting
• Backtracking Strategies for Accelerated Descent Methods with Smooth Composite Objectives
• Signal Recovery by Proximal Forward-Backward Splitting
• Some methods of speeding up the convergence of iteration methods
• Weak convergence of the sequence of successive approximations for nonexpansive mappings
• An introduction to continuous optimization for imaging
• An inertial proximal method for maximal monotone operators via discretization of a nonlinear oscillator with damping