Revisiting EXTRA for Smooth Distributed Optimization

DOI10.1137/18M122902XzbMath1447.90030arXiv2002.10110OpenAlexW3038991971MaRDI QIDQ3300767

Zhouchen Lin, Hu-An Li

Publication date: 30 July 2020

Published in: SIAM Journal on Optimization (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/2002.10110

zbMATH Keywords

EXTRAaccelerated distributed optimizationnear optimal communication complexity

Mathematics Subject Classification ID

Convex programming (90C25) Nonlinear programming (90C30)

Related Items (7)

Graph Topology Invariant Gradient and Sampling Complexity for Decentralized and Stochastic Optimization ⋮ Towards accelerated rates for distributed optimization over time-varying networks ⋮ Recent theoretical advances in decentralized distributed convex optimization ⋮ An Optimal Algorithm for Decentralized Finite-Sum Optimization ⋮ Decentralized and parallel primal and dual accelerated methods for stochastic convex programming problems ⋮ Projected subgradient based distributed convex optimization with transmission noises ⋮ Dualize, split, randomize: toward fast nonsmooth optimization algorithms

Uses Software

• HOGWILD

Cites Work

• Unnamed Item
• Distributed stochastic subgradient projection algorithms for convex optimization
• Introductory lectures on convex optimization. A basic course.
• Communication-efficient algorithms for decentralized and stochastic optimization
• DSA: Decentralized Double Stochastic Averaging Gradient Algorithm
• On the Convergence of Decentralized Gradient Descent
• Explicit Convergence Rate of a Distributed Alternating Direction Method of Multipliers
• Fast Distributed Gradient Methods
• Distributed asynchronous computation of fixed points
• Distributed asynchronous deterministic and stochastic gradient optimization algorithms
• Catalyst Acceleration for First-order Convex Optimization: from Theory to Practice
• Convergence Rate of Distributed ADMM Over Networks
• Distributed Linearized Alternating Direction Method of Multipliers for Composite Convex Consensus Optimization
• A Proximal Gradient Algorithm for Decentralized Composite Optimization
• Achieving Geometric Convergence for Distributed Optimization Over Time-Varying Graphs
• Harnessing Smoothness to Accelerate Distributed Optimization
• Fastest Mixing Markov Chain on a Graph
• Distributed Subgradient Methods for Multi-Agent Optimization
• EXTRA: An Exact First-Order Algorithm for Decentralized Consensus Optimization
• Asynchronous Broadcast-Based Convex Optimization Over a Network
• Optimal Distributed Online Prediction using Mini-Batches

This page was built for publication: Revisiting EXTRA for Smooth Distributed Optimization