Asymptotic Statistical Analysis of Sparse Group LASSO via Approximate Message Passing Algorithm

arXiv2107.01266MaRDI QIDQ6371864

Author name not available (Why is that?)

Publication date: 2 July 2021

Abstract: Sparse Group LASSO (SGL) is a regularized model for high-dimensional linear regression problems with grouped covariates. SGL applies $l_1$ and $l_2$ penalties on the individual predictors and group predictors, respectively, to guarantee sparse effects both on the inter-group and within-group levels. In this paper, we apply the approximate message passing (AMP) algorithm to efficiently solve the SGL problem under Gaussian random designs. We further use the recently developed state evolution analysis of AMP to derive an asymptotically exact characterization of SGL solution. This allows us to conduct multiple fine-grained statistical analyses of SGL, through which we investigate the effects of the group information and $gamma$ (proportion of $el{l}_1$ penalty). With the lens of various performance measures, we show that SGL with small $gamma$ benefits significantly from the group information and can outperform other SGL (including LASSO) or regularized models which do not exploit the group information, in terms of the recovery rate of signal, false discovery rate and mean squared error.

Has companion code repository: https://github.com/dosen4552/Sparse-Group-Lasso-AMP

This page was built for publication: Asymptotic Statistical Analysis of Sparse Group LASSO via Approximate Message Passing Algorithm

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6371864)