Practical perspectives on symplectic accelerated optimization
DOI10.1080/10556788.2023.2214837arXiv2207.11460OpenAlexW4376652647MaRDI QIDQ6087057
Valentin Duruisseaux, Melvin Leok
Publication date: 11 December 2023
Published in: Optimization Methods and Software (Search for Journal in Brave)
Full work available at URL: https://arxiv.org/abs/2207.11460
Hamiltonian dynamicssymplectic integratorsLagrangian dynamicsvariational integratorsgeometric numerical integrationaccelerated optimizationBregman dynamics
Numerical optimization and variational techniques (65K10) Dynamical systems in optimization and economics (37N40) Numerical methods for Hamiltonian systems including symplectic integrators (65P10) Discretization methods and integrators (symplectic, variational, geometric, etc.) for dynamical systems (37M15) Canonical and symplectic transformations for problems in Hamiltonian and Lagrangian mechanics (70H15)
Cites Work
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- On restart procedures for the conjugate gradient method
- On an asymptotically autonomous system with Tikhonov type regularizing term
- Variational integrators for almost-integrable systems
- General techniques for constructing variational integrators
- Asymptotic behavior of gradient-like dynamical systems involving inertia and multiscale aspects
- Accelerating the cubic regularization of Newton's method on convex problems
- Symplectic integrators for long-term integrations in celestial mechanics
- Geometric methods and optimization problems
- Variable time step integration with symplectic methods
- A second-order gradient-like dissipative dynamical system with Hessian-driven damping. Application to optimization and mechanics.
- Introductory lectures on convex optimization. A basic course.
- Lagrangian and Hamiltonian Taylor variational integrators
- Adaptive restart of the optimized gradient method for convex optimization
- On the Hamiltonian interpolation of near-to-the-identity symplectic mappings with application to symplectic integration algorithms
- Fast integration of rapidly oscillatory functions
- Fast convex optimization via inertial dynamics combining viscous and Hessian-driven damping with time rescaling
- First-order optimization algorithms via inertial systems with Hessian driven damping
- Accelerated optimization on Riemannian manifolds via discrete constrained variational integrators
- Restarting the accelerated coordinate descent method with a rough strong convexity estimate
- Adaptive restart for accelerated gradient schemes
- Combining fast inertial dynamics for convex optimization with Tikhonov regularization
- A simple nearly optimal restart scheme for speeding up first-order methods
- A Concise Introduction to Geometric Numerical Integration
- A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insights
- Prolongation-collocation variational integrators
- Discrete Hamiltonian variational integrators
- The Development of Variable-Step Symplectic Integrators, with Application to the Two-Body Problem
- Simulating Hamiltonian Dynamics
- Discrete mechanics and variational integrators
- A Technique for the Numerical Solution of Certain Integral Equations of the First Kind
- Procedures for Computing One- and Two-Dimensional Integrals of Functions with Rapid Irregular Oscillations
- Time transformations in the extended phase-space
- Restart procedures for the conjugate gradient method
- Geometric numerical integration illustrated by the Störmer–Verlet method
- Properties of Hamiltonian variational integrators
- Computing Highly Oscillatory Integrals
- A variational perspective on accelerated methods in optimization
- Adaptive Hamiltonian Variational Integrators and Applications to Symplectic Accelerated Optimization
- Tikhonov Regularization of a Perturbed Heavy Ball System with Vanishing Damping
- DYNAMICAL, SYMPLECTIC AND STOCHASTIC PERSPECTIVES ON GRADIENT-BASED OPTIMIZATION
- Sharpness, Restart, and Acceleration
- Adaptive restart of accelerated gradient methods under local quadratic growth condition
- Lie Groups, Lie Algebras, and Representations
- Discrete variational Hamiltonian mechanics
- Geometric Numerical Integration
- A Variational Formulation of Accelerated Optimization on Riemannian Manifolds
- Averaging methods in nonlinear dynamical systems
- Convergence of iterates for first-order optimization algorithms with inertia and Hessian driven damping
- Time-adaptive Lagrangian variational integrators for accelerated optimization
This page was built for publication: Practical perspectives on symplectic accelerated optimization
