Communication-Efficient Distributed Statistical Inference

DOI10.1080/01621459.2018.1429274zbMath1420.62097arXiv1605.07689OpenAlexW2964231067MaRDI QIDQ5231495

Michael I. Jordan, Jason D. Lee, Yun Yang

Publication date: 27 August 2019

Published in: Journal of the American Statistical Association (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1605.07689

zbMATH Keywords

likelihood approximationcommunication efficiencydistributed inference

Mathematics Subject Classification ID

Asymptotic properties of parametric estimators (62F12) Estimation in multivariate analysis (62H12) Ridge regression; shrinkage estimators (Lasso) (62J07) Point estimation (62F10) Bayesian inference (62F15)

Related Items

A review of distributed statistical inference, Discussion on ‘A review of distributed statistical inference’, Rejoinder on ‘A review of distributed statistical inference’, A selective review of statistical methods using calibration information from similar studies, A short note on fitting a single-index model with massive data, Optimal Distributed Subsampling for Maximum Quasi-Likelihood Estimators With Massive Data, An asymptotic analysis of distributed nonparametric methods, Distributed Sufficient Dimension Reduction for Heterogeneous Massive Data, Communication-efficient distributed estimator for generalized linear models with a diverging number of covariates, Distributed subdata selection for big data via sampling-based approach, Distributed nonparametric function estimation: optimal rate of convergence and cost of adaptation, Distributed optimization and statistical learning for large-scale penalized expectile regression, Robust distributed estimation and variable selection for massive datasets via rank regression, Optimal subsample selection for massive logistic regression with distributed data, WONDER: Weighted one-shot distributed ridge regression in high dimensions, Distributed estimation in heterogeneous reduced rank regression: with application to order determination in sufficient dimension reduction, On the role of statistics in the era of big data: a call for a debate, Robust covariance estimation for distributed principal component analysis, Global Consensus Monte Carlo, Least-Square Approximation for a Distributed System, Unnamed Item, Robust reduced rank regression in a distributed setting, Unnamed Item, Communication-Efficient Distributed Linear Discriminant Analysis for Binary Classification, Model Checking in Large-Scale Dataset via Structure-Adaptive-Sampling, Robust estimation for nonrandomly distributed data, Distributed inference for two‐sample U‐statistics in massive data analysis, New models for symbolic data analysis, Byzantine-robust distributed sparse learning for \(M\)-estimation, Distributed estimation with empirical likelihood, Distributed Sparse Composite Quantile Regression in Ultrahigh Dimensions, A communication-efficient method for ℓ₀ regularization linear regression models, Global debiased DC estimations for biased estimators via pro forma regression, Distributed penalized modal regression for massive data, Distributed learning for sketched kernel regression, Multivariate survival analysis in big data: A divide‐and‐combine approach, CEDAR: Communication Efficient Distributed Analysis for Regressions, Communication-efficient estimation for distributed subset selection, Subsampling and Jackknifing: A Practically Convenient Solution for Large Data Analysis With Limited Computational Resources, Model aggregation for doubly divided data with large size and large dimension, Distributed Estimation for Principal Component Analysis: An Enlarged Eigenspace Analysis, First-Order Newton-Type Estimator for Distributed Estimation and Inference, Individual Data Protected Integrative Regression Analysis of High-Dimensional Heterogeneous Data, Weighted expectile regression with covariates missing at random, Robust distributed multicategory angle-based classification for massive data, Distributed computation for marginal likelihood based model choice, Unnamed Item, Unnamed Item, Communication-efficient distributed estimation of partially linear additive models for large-scale data, Optimal subsampling algorithms for composite quantile regression in massive data, Autoregressive mixture models for clustering time series, Targeting underrepresented populations in precision medicine: a federated transfer learning approach, A communication efficient distributed one-step estimation, Distributed Decoding From Heterogeneous 1-Bit Compressive Measurements, Federated causal inference in heterogeneous observational data, Optimal decorrelated score subsampling for generalized linear models with massive data, Communication-efficient surrogate quantile regression for non-randomly distributed system, Divide-and-conquer Bayesian inference in hidden Markov models, Communication-efficient distributed estimation for high-dimensional large-scale linear regression, Communication-Efficient Accurate Statistical Estimation, Two-stage communication-efficient distributed sparse M-estimation with missing data, Model checking for parametric single-index models with massive datasets, Distributed statistical optimization for non-randomly stored big data with application to penalized learning, Asynchronous and Distributed Data Augmentation for Massive Data Settings, Network Gradient Descent Algorithm for Decentralized Federated Learning, Optimal Subsampling Bootstrap for Massive Data, Distributed estimation and inference for spatial autoregression model with large scale networks, Communication‐efficient low‐dimensional parameter estimation and inference for high‐dimensional Lp$$ {L}^p $$‐quantile regression, Estimation and inference in sparse multivariate regression and conditional Gaussian graphical models under an unbalanced distributed setting, Communication-efficient sparse composite quantile regression for distributed data, Unnamed Item, Unnamed Item, Unnamed Item, A Large-Scale Constrained Joint Modeling Approach for Predicting User Activity, Engagement, and Churn With Application to Freemium Mobile Games, LIC criterion for optimal subset selection in distributed interval estimation, Communication-efficient estimation of high-dimensional quantile regression, Unnamed Item, Parallel inference for big data with the group Bayesian method, A distributed one-step estimator, Robust distributed modal regression for massive data, Communication-efficient distributed \(M\)-estimation with missing data, Robust communication-efficient distributed composite quantile regression and variable selection for massive data, Unnamed Item, Unnamed Item, Communication-Efficient Distributed Eigenspace Estimation, Quantile regression under memory constraint, Distributed linear regression by averaging, Distributed adaptive Huber regression, Unnamed Item, Unnamed Item, Distributed adaptive Gaussian mean estimation with unknown variance: interactive protocol helps adaptation, High-performance statistical computing in the computing environments of the 2020s

Uses Software

• DiSCO

Cites Work

• On asymptotically optimal confidence regions and tests for high-dimensional models
• An MCMC approach to classical estimation.
• Communication-optimal Parallel and Sequential QR and LU Factorizations
• Divide and recombine (D&R): Data science for large complex data
• A Scalable Bootstrap for Massive Data
• Dual Averaging for Distributed Optimization: Convergence Analysis and Network Scaling
• Communication lower bounds for statistical estimation problems via a distributed data processing inequality
• A General Framework for Updating Belief Distributions
• Distributed Matrix Completion and Robust Factorization
• Unnamed Item
• Unnamed Item
• Unnamed Item