Train Like a (Var)Pro: Efficient Training of Neural Networks with Variable Projection
From MaRDI portal
Publication:5162626
DOI10.1137/20M1359511OpenAlexW3203078849MaRDI QIDQ5162626
Bart G. van Bloemen Waanders, Elizabeth Newman, Joseph Hart, Lars Ruthotto
Publication date: 3 November 2021
Published in: SIAM Journal on Mathematics of Data Science (Search for Journal in Brave)
Full work available at URL: https://arxiv.org/abs/2007.13171
neural networksnumerical optimizationdeep learningvariable projectionhyperspectral segmentationPDE surrogate modeling
Related Items
Numerical approximation of partial differential equations by a variable projection method with artificial neural networks, slimTrain---A Stochastic Approximation Method for Training Separable Deep Neural Networks, A variable projection method for large-scale inverse problems with \(\ell^1\) regularization, A method for computing inverse parametric PDE problems with random-weight neural networks
Uses Software
Cites Work
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- A numerical approach to the study of spatial pattern formation in the ligaments of arcoid bivalves
- Handbook of simulation optimization
- A weighted-GCV method for Lanczos-hybrid regularization
- Variable projections neural network training
- Bifurcation and spatiotemporal patterns in a homogeneous diffusive predator-prey system
- An implicit shift bidiagonalization algorithm for ill-posed systems
- The Deep Ritz Method: a deep learning-based numerical algorithm for solving variational problems
- Deep neural networks motivated by partial differential equations
- Deep UQ: learning deep neural network surrogate models for high dimensional uncertainty quantification
- DGM: a deep learning algorithm for solving partial differential equations
- Instabilities in spatially extended predator-prey systems: spatio-temporal patterns in the neighborhood of Turing-Hopf bifurcations
- Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
- Variable projection for nonlinear least squares problems
- A proposal on machine learning via dynamical systems
- Optimal control for a groundwater pollution ruled by a convection-diffusion-reaction problem
- The Sample Average Approximation Method for Stochastic Discrete Optimization
- Robust Stochastic Approximation Approach to Stochastic Programming
- A variable projection method for solving separable nonlinear least squares problems
- Separable nonlinear least squares: the variable projection method and its applications
- Stable architectures for deep neural networks
- Optimization Methods for Large-Scale Machine Learning
- Solving high-dimensional partial differential equations using deep learning
- A hybrid, non-split, stiff/RKC, solver for advection–diffusion–reaction equations and its application to low-Mach number combustion
- Computational Methods for Multiphase Flows in Porous Media
- Discrete Inverse Problems
- Numerical methods for coupled super-resolution
- The Differentiation of Pseudo-Inverses and Nonlinear Least Squares Problems Whose Variables Separate
- A Stochastic Approximation Method
- Exact and inexact subsampled Newton methods for optimization
- Approximation by superpositions of a sigmoidal function
