Homotopy relaxation training algorithms for infinite-width two-layer ReLU neural networks
type: Item
instance of: scholarly article
title: Homotopy relaxation training algorithms for infinite-width two-layer ReLU neural networks
author: Yahong Yang
author: Qipin Chen
author: Wenrui Hao
published in: Journal of Scientific Computing
publication date: 2025-01-17T00:00:00Z
Mathematics Subject Classification ID: 68T07
Mathematics Subject Classification ID: 68W10
Mathematics Subject Classification ID: 65K99
zbMATH DE Number: 7969185
zbMATH Keywords: neural networks
zbMATH Keywords: homotopy
zbMATH Keywords: relaxation
zbMATH Keywords: optimization
MaRDI profile type: Publication
cites work: A homotopy training algorithm for fully connected neural networks
cites work: Why does unsupervised pre-training help deep learning?
cites work: A homotopy method for parameter estimation of nonlinear differential equations with multiple optima
cites work: An adaptive homotopy tracking algorithm for solving nonlinear parametric systems with applications in nonlinear ODEs
cites work: Side effects of learning from low-dimensional data embedded in a Euclidean space
cites work: Neural tangent kernel: convergence and generalization in neural networks (invited paper)
cites work: Adaptive activation functions accelerate convergence in deep and physics-informed neural networks
cites work: Locally adaptive activation functions with slope recovery for deep and physics-informed neural networks
cites work: Scaling Limit of the Stein Variational Gradient Descent: The Mean Field Regime
cites work: Q4998974
cites work: Computing all solutions to polynomial systems using homotopy continuation
cites work: Accelerated Optimization with Orthogonality Constraints
cites work: Greedy training algorithms for neural networks and applications to PDEs
cites work: The Numerical Solution of Systems of Polynomials Arising in Engineering and Science
cites work: High-Dimensional Probability
cites work: Sobolev training of thermodynamic-informed neural networks for interpretable elasto-plasticity models with level set hardening
cites work: The Deep Ritz Method: a deep learning-based numerical algorithm for solving variational problems
DOI: 10.1007/S10915-024-02761-5
description: scientific article; zbMATH DE number 7969185