Swarm-based gradient descent meets simulated annealing

DOI10.1137/24m1657808MaRDI QIDQ6658286

Zhiyan Ding, Eitan Tadmor, Qin Li, Martin Guerra

Publication date: 8 January 2025

Published in: SIAM Journal on Numerical Analysis (Search for Journal in Brave)

zbMATH Keywords

optimizationsimulated annealingstochastic gradient descentprovisional minimumswarm-based gradient descent

Mathematics Subject Classification ID

Nonconvex programming, global optimization (90C26) Numerical optimization and variational techniques (65K10) Population dynamics (general) (92D25)

Cites Work

• Unnamed Item
• Unnamed Item
• Optimization by Simulated Annealing
• On the rate of convergence in Wasserstein distance of the empirical measure
• Thermodynamical approach to the travelling salesman problem: An efficient simulation algorithm
• Nonstationary Markov chains and convergence of the annealing algorithm
• Hypocoercivity in metastable settings and kinetic simulated annealing
• A consensus-based model for global optimization and its mean-field limit
• Firefly Algorithms for Multimodal Optimization
• Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images
• Diffusions for Global Optimization
• Diffusion for Global Optimization in $\mathbb{R}^n $
• The Theory and Practice of Simulated Annealing
• An analytical framework for consensus-based global optimization method
• A consensus-based global optimization method for high dimensional machine learning problems
• Trends in Consensus-Based Optimization
• The Wind Driven Optimization Technique and its Application in Electromagnetics
• Swarm-based optimization with random descent
• Consensus-based optimization methods converge globally

This page was built for publication: Swarm-based gradient descent meets simulated annealing