Stochastic generalized gradient methods for training nonconvex nonsmooth neural networks

DOI10.1007/s10559-021-00397-zzbMath1494.65047OpenAlexW3204008412MaRDI QIDQ2058689

Vladimir I. Norkin

Publication date: 9 December 2021

Published in: Cybernetics and Systems Analysis (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1007/s10559-021-00397-z

zbMATH Keywords

stochastic optimizationmachine learningnonsmooth nonconvex optimizationdeep learningmultilayer neural networksstochastic generalized gradient

Mathematics Subject Classification ID

Artificial neural networks and deep learning (68T07) Numerical mathematical programming methods (65K05) Nonconvex programming, global optimization (90C26) Stochastic programming (90C15)

Related Items (1)

Subgradient Sampling for Nonsmooth Nonconvex Minimization

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Empirical risk minimization and problems of constructing linear classifiers
• Solution of nonconvex nonsmooth stochastic optimization problems
• Tame functions are semismooth
• Stochastic generalized gradient method for nonconvex nonsmooth stochastic optimization
• Generalized gradients in dynamic optimization, optimal control, and machine learning problems
• Stochastic subgradient method converges on tame functions
• Machine Learning
• Stochastic generalized-differentiable functions in the problem of nonconvex nonsmooth stochastic optimization
• Lectures on Stochastic Programming
• Robust Stochastic Approximation Approach to Stochastic Programming
• Step control for direct stochastic-programming methods
• An Algorithm for Constrained Optimization with Semismooth Functions
• Stochastic Model-Based Minimization of Weakly Convex Functions
• Optimization Methods for Large-Scale Machine Learning
• A Robust Gradient Sampling Algorithm for Nonsmooth, Nonconvex Optimization
• Learning representations by back-propagating errors
• A Stochastic Approximation Method

This page was built for publication: Stochastic generalized gradient methods for training nonconvex nonsmooth neural networks