On the Linear Convergence of the ADMM in Decentralized Consensus Optimization

DOI10.1109/TSP.2014.2304432zbMath1394.94532arXiv1307.5561OpenAlexW2123705108MaRDI QIDQ4579106

Wotao Yin, Kun Yuan, Wei Shi, Qing Ling, Gang Wu

Publication date: 22 August 2018

Published in: IEEE Transactions on Signal Processing (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1307.5561

Mathematics Subject Classification ID

Applications of mathematical programming (90C90) Approximation methods and heuristics in mathematical programming (90C59) Signal theory (characterization, reconstruction, filtering, etc.) (94A12)

Related Items

Optimal Algorithms for Non-Smooth Distributed Optimization in Networks, A survey on some recent developments of alternating direction method of multipliers, A novel bound on the convergence rate of ADMM for distributed optimization, Distributed Optimization Based on Gradient Tracking Revisited: Enhancing Convergence Rate via Surrogation, A relative error-based approach for variable selection, A unitary distributed subgradient method for multi-agent optimization with different coupling sources, Distributed constraint-coupled optimization via primal decomposition over random time-varying graphs, A distributed methodology for approximate uniform global minimum sharing, Distributed discrete-time convex optimization with nonidentical local constraints over time-varying unbalanced directed graphs, Distributed Model Predictive Control of linear discrete-time systems with local and global constraints, Improving the convergence of distributed gradient descent via inexact average consensus, Distributed support vector machine in master-slave mode, A fast proximal gradient algorithm for decentralized composite optimization over directed networks, Dual decomposition for multi-agent distributed optimization with coupling constraints, Tracking-ADMM for distributed constraint-coupled optimization, Linear convergence of primal-dual gradient methods and their performance in distributed optimization, Tight global linear convergence rate bounds for Douglas-Rachford splitting, A sequential ADMM algorithm to find sparse LCP solutions using a \(l_2-l_1\) regularization technique with application in bimatrix game, An accelerated exact distributed first-order algorithm for optimization over directed networks, A stochastic averaging gradient algorithm with multi‐step communication for distributed optimization, Decentralized ADMM with compressed and event-triggered communication, Distributed Nash equilibrium learning: A second‐order proximal algorithm, Sparsity promoting decentralized learning strategies for radio tomographic imaging using consensus based ADMM approach, Decentralized nonconvex optimization with guaranteed privacy and accuracy, Graph Topology Invariant Gradient and Sampling Complexity for Decentralized and Stochastic Optimization, A divide-and-conquer algorithm for distributed optimization on networks, A decentralized smoothing quadratic regularization algorithm for composite consensus optimization with non-Lipschitz singularities, Neurodynamic approaches for multi-agent distributed optimization, Linear convergence of distributed estimation with constraints and communication delays, Learning Coefficient Heterogeneity over Networks: A Distributed Spanning-Tree-Based Fused-Lasso Regression, A review of decentralized optimization focused on information flows of decomposition algorithms, Gradient-tracking based differentially private distributed optimization with enhanced optimization accuracy, Event-triggered primal-dual design with linear convergence for distributed nonstrongly convex optimization, Achieving Geometric Convergence for Distributed Optimization Over Time-Varying Graphs, Distributed online semi-supervised support vector machine, A two-level distributed algorithm for nonconvex constrained optimization, Distributed subgradient method for multi-agent optimization with quantized communication, Review of mathematical methodology for electric power optimization problems, A generic online acceleration scheme for optimization algorithms via relaxation and inertia, Online supervised learning with distributed features over multiagent system, Distributed model predictive control for continuous‐time nonlinear systems based on suboptimal ADMM, Convergence of distributed gradient-tracking-based optimization algorithms with random graphs, Decentralized Consensus Algorithm with Delayed and Stochastic Gradients, Distributed convex optimization with coupling constraints over time-varying directed graphs, Unnamed Item, Unnamed Item, Parallel alternating direction method of multipliers, Communication-computation tradeoff in distributed consensus optimization for MPC-based coordinated control under wireless communications, Alternating stationary iterative methods based on double splittings, Distributed Robust Subspace Recovery, Exponential convergence of distributed primal-dual convex optimization algorithm without strong convexity, Decentralized optimization over tree graphs, On the linear convergence of two decentralized algorithms, Augmented Lagrange algorithms for distributed optimization over multi-agent networks via edge-based method, A simple effective heuristic for embedded mixed-integer quadratic programming, A zero-gradient-sum algorithm for distributed cooperative learning using a feedforward neural network with random weights, ADMM for multiaffine constrained optimization, Communication-efficient algorithms for decentralized and stochastic optimization, Learning smooth representations with generalized softmax for unsupervised domain adaptation, Distributed decision-coupled constrained optimization via proximal-tracking, Solving Fused Penalty Estimation Problems via Block Splitting Algorithms, Distributed Subgradient-Free Stochastic Optimization Algorithm for Nonsmooth Convex Functions over Time-Varying Networks, A randomized incremental primal-dual method for decentralized consensus optimization, Distributed multi-step subgradient optimization for multi-agent system, Distributed Newton methods for strictly convex consensus optimization problems in multi-agent networks, EXTRA: An Exact First-Order Algorithm for Decentralized Consensus Optimization, Proximal ADMM for nonconvex and nonsmooth optimization, Unnamed Item, On the convergence of exact distributed generalisation and acceleration algorithm for convex optimisation, Distributed primal-dual optimisation method with uncoordinated time-varying step-sizes, Online learning over a decentralized network through ADMM, Newton-like Method with Diagonal Correction for Distributed Optimization