Nonlinear Least Squares for Large-Scale Machine Learning using Stochastic Jacobian Estimates

Author name not available (Why is that?)

Publication date: 12 July 2021

Abstract: For large nonlinear least squares loss functions in machine learning we exploit the property that the number of model parameters typically exceeds the data in one batch. This implies a low-rank structure in the Hessian of the loss, which enables effective means to compute search directions. Using this property, we develop two algorithms that estimate Jacobian matrices and perform well when compared to state-of-the-art methods.

Has companion code repository: https://github.com/johannesbrust/SNLLS

Mathematics Subject Classification ID

No records found.

This page was built for publication: Nonlinear Least Squares for Large-Scale Machine Learning using Stochastic Jacobian Estimates

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6372600)