Q5148924
type: Item
instance of: scholarly article
author: James Martens
publication date: 2021-02-05T00:00:00Z
full work available at URL: https://arxiv.org/abs/1412.1193
full work available at URL: 17-678.html
Mathematics Subject Classification ID: 68T05
zbMATH DE Number: 7306852
zbMATH Keywords: natural gradient methods
zbMATH Keywords: 2nd-order optimization
zbMATH Keywords: neural networks
zbMATH Keywords: convergence rate
zbMATH Keywords: parameterization invariance
describes a project that uses: Adam
describes a project that uses: ADADELTA
describes a project that uses: SGD-QN
describes a project that uses: RMSprop
MaRDI profile type: Publication
cites work: New Classes of Synchronous Codes
cites work: Q4527387
cites work: Information-Geometric Optimization Algorithms: A Unifying Picture via Invariance Principles
cites work: SGD-QN: careful quasi-Newton stochastic gradient descent
cites work: On‐line learning for very large data sets
cites work: Hessian Matrix vs. Gauss–Newton Hessian Matrix
cites work: Trust Region Methods
cites work: Inexact Newton Methods
cites work: Q4868581
cites work: Q5396673
cites work: Q4226179
cites work: Logarithmic Regret Algorithms for Online Convex Optimization
cites work: Q4421713
cites work: A method for the solution of certain non-linear problems in least squares
cites work: An Algorithm for Least-Squares Estimation of Nonlinear Parameters
cites work: Q4148902
cites work: Computing a Trust Region Step
cites work: Q4762626
cites work: Preconditioning of Truncated-Newton Methods
cites work: Introductory lectures on convex optimization. A basic course.
cites work: Q5491447
cites work: Riemannian metrics for neural networks I: feedforward networks
cites work: Online natural gradient as a Kalman filter
cites work: Iterative Solution of Nonlinear Equations in Several Variables
cites work: Acceleration of Stochastic Approximation by Averaging
cites work: Fast Curvature Matrix-Vector Products for Second-Order Gradient Descent
cites work: The Conjugate Gradient Method and Trust Regions in Large Scale Optimization
cites work: The ubiquitous Kronecker product
cites work: Trace bounds on the solution of the algebraic matrix Riccati and Lyapunov equation
cites work: 75.9 Euler’s Constant
description: scientific article; zbMATH DE number 7306852