A consensus-based global optimization method for high dimensional machine learning problems
From MaRDI portal
Publication:4999582
DOI10.1051/cocv/2020046zbMath1480.60195arXiv1909.09249OpenAlexW3044387630MaRDI QIDQ4999582
Yuhua Zhu, Lei Li, Shih Jin, José Antonio Carrillo
Publication date: 7 July 2021
Published in: ESAIM: Control, Optimisation and Calculus of Variations (Search for Journal in Brave)
Full work available at URL: https://arxiv.org/abs/1909.09249
Numerical optimization and variational techniques (65K10) Learning and adaptive systems in artificial intelligence (68T05) Computational methods for stochastic equations (aspects of stochastic analysis) (60H35) (n)-body problems (70F10)
Related Items (38)
Aggregation and disaggregation of active particles on the unit sphere with time-dependent frequencies ⋮ Constrained Consensus-Based Optimization ⋮ Efficient derivative-free Bayesian inference for large-scale inverse problems ⋮ Trends in Consensus-Based Optimization ⋮ Binary interaction methods for high dimensional global optimization and machine learning ⋮ Stochastic consensus dynamics for nonconvex optimization on the Stiefel manifold: Mean-field limit and convergence ⋮ A Consensus-Based Global Optimization Method with Adaptive Momentum Estimation ⋮ Zero-Inertia Limit: From Particle Swarm Optimization to Consensus-Based Optimization ⋮ Anisotropic Diffusion in Consensus-Based Optimization on the Sphere ⋮ Global Optimization via Schrödinger–Föllmer Diffusion ⋮ Convergence analysis of the discrete consensus-based optimization algorithm with random batch interactions and heterogeneous noises ⋮ Consensus‐based sampling ⋮ On the stochastic robustness of complete clustering predictability for a first‐order consensus model ⋮ On the mean‐field limit for the consensus‐based optimization ⋮ Parameter Calibration with Consensus-Based Optimization for Interaction Dynamics Driven by Neural Networks ⋮ Reproducing kernel Hilbert spaces in the mean field limit ⋮ Consensus-based optimization via jump-diffusion stochastic differential equations ⋮ Kinetic-based optimization enhanced by genetic dynamics ⋮ Swarm-based optimization with random descent ⋮ Collective behaviors of stochastic agent-based models and applications to finance and optimization ⋮ An adaptive consensus based method for multi-objective optimization with uniform Pareto front approximation ⋮ On the global convergence of particle swarm optimization methods ⋮ Ensemble-Based Gradient Inference for Particle Methods in Optimization and Sampling ⋮ Leader-Following Rendezvous Control for Generalized Cucker-Smale Model on Riemannian Manifolds ⋮ An eikonal equation with vanishing Lagrangian arising in global optimization ⋮ Convergence toward equilibrium of the first-order consensus model with random batch interactions ⋮ Unnamed Item ⋮ Cluster Synchrony of High-Dimensional Kuramoto Models with Higher-Order Couplings ⋮ Uniform-in-time error estimate of the random batch method for the Cucker–Smale model ⋮ Model predictive control with random batch methods for a guiding problem ⋮ From particle swarm optimization to consensus based optimization: Stochastic modeling and mean-field limit ⋮ Consensus-based optimization on hypersurfaces: Well-posedness and mean-field limit ⋮ A constrained consensus based optimization algorithm and its application to finance ⋮ One dimensional consensus based algorithm for non-convex optimization ⋮ Propagation of chaos: a review of models, methods and applications. I: Models and methods ⋮ Propagation of chaos: a review of models, methods and applications. II: Applications ⋮ Convergence analysis of particle swarm optimization in one dimension ⋮ Complete solvability of the inertial spin model with an averaged spin
Cites Work
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Optimization by Simulated Annealing
- Simple upper and lower bounds for the multivariate Laplace approximation
- Kinetic models of opinion formation
- \(N\)-particles approximation of the Vlasov equations with singular potential
- Asymptotics of the spectral gap with applications to the theory of simulated annealing
- Large-time behavior of perturbed diffusion Markov processes with applications to the second eigenvalue problem for Fokker-Planck operators and simulated annealing
- From particle to kinetic and hydrodynamic descriptions of flocking
- On the mathematics of emergence
- Error bounds for multidimensional Laplace approximation
- Quantitative estimates of propagation of chaos for stochastic systems with \(W^{-1,\infty}\) kernels
- Random batch methods (RBM) for interacting particle systems
- Contagion shocks in one dimension
- A review of the mean field limits for Vlasov equations
- A theorem on the asymptotic behavior of a multiple integral
- From the Microscale to Collective Crowd Dynamics
- STOCHASTIC MEAN-FIELD LIMIT: NON-LIPSCHITZ FORCES AND SWARMING
- Heterophilious Dynamics Enhances Consensus
- A consensus-based model for global optimization and its mean-field limit
- Asymptotic Flocking Dynamics for the Kinetic Cucker–Smale Model
- Particle, kinetic, and hydrodynamic models of swarming
- An analytical framework for consensus-based global optimization method
- Particle Based gPC Methods for Mean-Field Models of Swarming with Uncertainty
- Binary Interaction Algorithms for the Simulation of Flocking and Swarming Dynamics
- A Simplex Method for Function Minimization
- A Stochastic Approximation Method
This page was built for publication: A consensus-based global optimization method for high dimensional machine learning problems
