On the Convergence of Mirror Descent beyond Stochastic Convex Programming
From MaRDI portal
Publication:5853716
DOI10.1137/17M1134925zbMath1461.90085arXiv1706.05681OpenAlexW3008600123MaRDI QIDQ5853716
Nicholas Bambos, Zhengyuan Zhou, Panayotis Mertikopoulos, Stephen P. Boyd, Peter W. Glynn
Publication date: 11 March 2021
Published in: SIAM Journal on Optimization (Search for Journal in Brave)
Full work available at URL: https://arxiv.org/abs/1706.05681
stochastic optimizationstochastic approximationnonconvex programmingmirror descentvariational coherence
Convex programming (90C25) Nonconvex programming, global optimization (90C26) Linear programming (90C05) Stochastic programming (90C15)
Related Items
Asymptotic properties of dual averaging algorithm for constrained distributed stochastic optimization, Stochastic mirror descent method for linear ill-posed problems in Banach spaces, Stochastic incremental mirror descent algorithms with Nesterov smoothing, Global Convergence of Policy Gradient Methods to (Almost) Locally Optimal Policies, Distributed Stochastic Optimization with Large Delays
Cites Work
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Primal-dual subgradient methods for convex problems
- Accelerated gradient methods for nonconvex nonlinear and stochastic programming
- Exponentiated gradient versus gradient descent for linear predictors
- Validation analysis of mirror descent stochastic approximation method
- Linear programming: foundations and extensions
- Introductory lectures on convex optimization. A basic course.
- Learning in games with continuous action sets and unknown payoff functions
- Mirror descent and nonlinear projected subgradient methods for convex optimization.
- Gradient descent with random initialization: fast global convergence for nonconvex phase retrieval
- A Complementary Pivoting Approach to the Maximum Weight Clique Problem
- Convergence Analysis of a Proximal-Like Minimization Algorithm Using Bregman Functions
- Online Learning and Online Convex Optimization
- Robust Stochastic Approximation Approach to Stochastic Programming
- Asymptotic Analysis for Penalty and Barrier Methods in Convex and Linear Programming
- Free-Steering Relaxation Methods for Problems with Strictly Convex Costs and Linear Constraints
- Variational Analysis
- Stochastic Methods for Composite and Weakly Convex Optimization Problems
- On the Convergence of Gradient-Like Flows with Noisy Gradient Input
- Distributed Stochastic Optimization via Matrix Exponential Learning
- Prox-Method with Rate of Convergence O(1/t) for Variational Inequalities with Lipschitz Continuous Monotone Operators and Smooth Convex-Concave Saddle Point Problems
- Finite-Dimensional Variational Inequalities and Complementarity Problems
- Ergodic Mirror Descent
- Stochastic Approximation Approaches to the Stochastic Variational Inequality Problem
- On Stochastic Subgradient Mirror-Descent Algorithm with Weighted Averaging
- Solving variational inequalities with Stochastic Mirror-Prox algorithm
- Stochastic First- and Zeroth-Order Methods for Nonconvex Stochastic Programming
- Convex Analysis
- A Stochastic Approximation Method
- A new version of extragradient method for variational inequality problems