First order inertial optimization algorithms with threshold effects associated with dry friction

DOI10.1007/s10589-023-00509-9OpenAlexW3179858705MaRDI QIDQ6146366

Hedy Attouch, Manh Hung Le, Samir Adly

Publication date: 10 January 2024

Published in: Computational Optimization and Applications (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1007/s10589-023-00509-9

zbMATH Keywords

errorsoptimizationdry frictionHessian-driven dampingsoft thresholdingKurdyka-Lojasiewicz propertyinertial methodsLasso problemproximal-gradient algorithms

Mathematics Subject Classification ID

Dynamical systems in optimization and economics (37N40) Optimality conditions for problems involving ordinary differential equations (49K15) Methods of reduced gradient type (90C52)

Related Items

In memoriam: Asen L. Dontchev (1948--2021)

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
• Fast convex optimization via inertial dynamics with Hessian driven damping
• Asymptotic for the perturbed heavy ball system with vanishing damping term
• How to regularize a difference of convex functions
• Duality in nonconvex optimization
• Error stability properties of generalized gradient-type algorithms
• A second-order gradient-like dissipative dynamical system with Hessian-driven damping. Application to optimization and mechanics.
• A note on the dynamics of an oscillator in the presence of strong friction.
• Introductory lectures on convex optimization. A basic course.
• Inertial forward-backward algorithms with perturbations: application to Tikhonov regularization
• The DC (Difference of convex functions) programming and DCA revisited with DC models of real world nonconvex optimization problems
• Convergence of descent methods for semi-algebraic and tame problems: proximal algorithms, forward-backward splitting, and regularized Gauss-Seidel methods
• Understanding the acceleration phenomenon via high-resolution differential equations
• A control-theoretic perspective on optimal high-order optimization
• On the effect of perturbations in first-order optimization methods with inertia and Hessian driven damping
• First-order optimization algorithms via inertial systems with Hessian driven damping
• First-order inertial algorithms involving dry friction damping
• Tikhonov regularization of a second order dynamical system with Hessian driven damping
• Accelerated proximal point method for maximally monotone operators
• Fast convergence of inertial dynamics and algorithms with asymptotic vanishing viscosity
• Local and global smoothing effects for some linear hyperbolic equations with a strong dissipation
• Second Order Forward-Backward Dynamical Systems For Monotone Inclusion Problems
• A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insights
• Accelerated and Inexact Forward-Backward Algorithms
• Variational Analysis in Sobolev and BV Spaces
• Evolution equations for maximal monotone operators: asymptotic analysis in continuous and discrete time
• Proximal Alternating Minimization and Projection Methods for Nonconvex Problems: An Approach Based on the Kurdyka-Łojasiewicz Inequality
• Stability of Over-Relaxations for the Forward-Backward Algorithm, Application to FISTA
• Characterizations of Łojasiewicz inequalities: Subgradient flows, talweg, convexity
• An Invitation to Tame Optimization
• Convergence Rates of Inertial Forward-Backward Algorithms
• Convergence Rates of the Heavy Ball Method for Quasi-strongly Convex Optimization
• Finite Convergence of Proximal-Gradient Inertial Algorithms Combining Dry Friction with Hessian-Driven Damping
• An Inertial Newton Algorithm for Deep Learning
• A second-order dynamical approach with variable damping to nonconvex smooth minimization
• Some methods of speeding up the convergence of iteration methods
• An introduction to continuous optimization for imaging
• Convex analysis and monotone operator theory in Hilbert spaces
• Benchmarking optimization software with performance profiles.
• Fast optimization via inertial dynamics with closed-loop damping

This page was built for publication: First order inertial optimization algorithms with threshold effects associated with dry friction