Alternating Structure-Adapted Proximal Gradient Descent for Nonconvex Nonsmooth Block-Regularized Problems

DOI10.1137/17M1142624zbMath1421.90142MaRDI QIDQ5231698

Pauline Tan, Mila Nikolova

Publication date: 27 August 2019

Published in: SIAM Journal on Optimization (Search for Journal in Brave)

zbMATH Keywords

global convergenceblock coordinate descentforward-backward splittingalternating minimizationKurdyka-Łojasiewicz propertysubdifferential calculusproximal gradient descentnonconvex-nonsmooth optimization

Mathematics Subject Classification ID

Ill-posedness and regularization problems in numerical linear algebra (65F22) Numerical mathematical programming methods (65K05) Nonconvex programming, global optimization (90C26) Nonlinear programming (90C30) Numerical optimization and variational techniques (65K10) Optimality conditions and duality in mathematical programming (90C46) Iterative procedures involving nonlinear operators (47J25) Numerical methods based on nonlinear programming (49M37)

Related Items

Some accelerated alternating proximal gradient algorithms for a class of nonconvex nonsmooth problems, A generalized inertial proximal alternating linearized minimization method for nonconvex nonsmooth problems, An alternating structure-adapted Bregman proximal gradient descent algorithm for constrained nonconvex nonsmooth optimization problems and its inertial variant, Global optimization for non-convex programs via convex proximal point method, Inertial alternating generalized forward-backward splitting for image colorization, Choose Your Path Wisely: Gradient Descent in a Bregman Distance Framework

Cites Work

• Unnamed Item
• Unnamed Item
• Proximal alternating linearized minimization for nonconvex and nonsmooth problems
• Smoothing methods for nonsmooth, nonconvex minimization
• A block coordinate variable metric forward-backward algorithm
• On the convergence of the proximal algorithm for nonsmooth functions involving analytic features
• Semianalytic and subanalytic sets
• Asymptotic properties of the Fenchel dual functional and applications to decomposition problems
• A globally convergent algorithm for nonconvex optimization based on block coordinate update
• Convergence of descent methods for semi-algebraic and tame problems: proximal algorithms, forward-backward splitting, and regularized Gauss-Seidel methods
• Alternating proximal gradient method for sparse nonnegative Tucker decomposition
• Biconvex sets and optimization with biconvex functions: a survey and extensions
• An Alternating Semiproximal Method for Nonconvex Regularized Structured Total Least Squares Problems
• Nonconvex TV$^q$-Models in Image Restoration: Analysis and a Trust-Region Regularization--Based Superlinearly Convergent Solver
• A Block Coordinate Descent Method for Regularized Multiconvex Optimization with Applications to Nonnegative Tensor Factorization and Completion
• Smoothing and First Order Methods: A Unified Framework
• Analysis of a Variational Framework for Exemplar-Based Image Inpainting
• An Unconstrained $\ell_q$ Minimization with $0q\leq1$ for Sparse Solution of Underdetermined Linear Systems
• Smoothing Nonlinear Conjugate Gradient Method for Image Restoration Using Nonsmooth Nonconvex Minimization
• Proximal Alternating Minimization and Projection Methods for Nonconvex Problems: An Approach Based on the Kurdyka-Łojasiewicz Inequality
• Inertial Proximal Alternating Linearized Minimization (iPALM) for Nonconvex and Nonsmooth Problems
• Clarke Subgradients of Stratifiable Functions
• A New Class of Alternating Proximal Minimization Algorithms with Costs-to-Move
• Variational Analysis
• A long and winding road to definable sets
• Proximal Heterogeneous Block Implicit-Explicit Method and Application to Blind Ptychographic Diffraction Imaging
• On the Convergence of Block Coordinate Descent Type Methods
• The Łojasiewicz Inequality for Nonsmooth Subanalytic Functions with Applications to Subgradient Dynamical Systems
• Convergence of the Iterates of Descent Methods for Analytic Cost Functions
• Proximité et dualité dans un espace hilbertien
• Penalty Methods for a Class of Non-Lipschitz Optimization Problems
• Convex analysis and monotone operator theory in Hilbert spaces
• Convergence of a block coordinate descent method for nondifferentiable minimization