Statistical Analysis of Fixed Mini-Batch Gradient Descent Estimator

DOI10.1080/10618600.2023.2204130arXiv2304.06564MaRDI QIDQ6181404

Hansheng Wang, Haobo Qi, Feifei Wang

Publication date: 22 January 2024

Published in: Journal of Computational and Graphical Statistics (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/2304.06564

zbMATH Keywords

gradient descentstochastic gradient descentrandom shufflingfixed mini-batchlearning rate scheduling

Mathematics Subject Classification ID

Statistics (62-XX)

Cites Work

• Unnamed Item
• Unnamed Item
• Introductory lectures on convex optimization. A basic course.
• Bridging the gap between constant step size stochastic gradient descent and Markov chains
• First-order and stochastic optimization methods for machine learning
• Asymptotic and finite-sample properties of estimators based on stochastic gradients
• Robust Stochastic Approximation Approach to Stochastic Programming
• Optimization Methods for Large-Scale Machine Learning

This page was built for publication: Statistical Analysis of Fixed Mini-Batch Gradient Descent Estimator