Bayesian estimation of sparse signals with a continuous spike-and-slab prior
type: Item
instance of: scholarly article
title: Bayesian estimation of sparse signals with a continuous spike-and-slab prior
zbMATH Open document ID: 1395.62230
DOI: 10.1214/17-AOS1554
published in: The Annals of Statistics
publication date: 2018-04-27T00:00:00Z
review text: The author provides a unified perspective on Bayesian estimation of sparse signals with continuous spike-and-slab prior combining both penalized likelihood and fully Bayes perspective. More precisely, the author focuses on the canonical problem of estimation a high dimensional mean vector from a single multivariate observation. The observed vector arises from \[ Y_i=\beta_{0i}+\epsilon_i,\quad \epsilon\sim N(0,1),\;i=1,\dots,n, \] and the goal is to estimate \(\beta=(\beta_{01,}, \dots, \beta_{0n})^{\prime}\) under squared error loss. The sparsity is defined as \(\beta_0\in l_0[p_n;n]= \{\beta \in \mathbb{R}^n\,:\,\sum_{i=1}^n I(|\beta_i|\neq0)\leq p_n\}\) and \(p(n)=o(n)\) as \(n\to\infty\). The quality of recovery is assessed relative to the benchmark minimax risk \(2p_n\log (n/p)(1+o(1))\) and the mean minimax risk \(2p_n\log\,n(1+o(1))\). The author adapts the view that a good point estimator should have a minimax risk that is always within a universal constant multiple of the (near) minimax risk. The spike-and-slab prior SS-LASSO prior is of the form \[ \pi(\beta\,|\,\gamma)=\prod_{i=1}^{n}[(1-\gamma_i)\psi (\beta_i\,|\,\lambda_0)+\gamma_i \psi(\beta_i\,|\,\lambda_1)], \quad \gamma\sim\pi(\phi\,|\,\theta), \] where \(\psi(\beta\,|\,l)=(\lambda/2)\exp\{-\lambda|\beta|\}\) is a Laplace distribution with mean 0 and variance \(2/\lambda^2\). For the class of SS-LASSO priors a rigorous frequentist analysis of the entire posterior distribution and its modes is provided.
reviewed by: Jaromír Antoch
Mathematics Subject Classification ID: 62J99
Mathematics Subject Classification ID: 62F15
Mathematics Subject Classification ID: 62C12
Mathematics Subject Classification ID: 62J07
zbMATH DE Number: 6865116
zbMATH Keywords: asymptotic minimaxity
zbMATH Keywords: Lasso
zbMATH Keywords: posterior concentration
zbMATH Keywords: spike-and-slab
author: Veronika Rockova
describes a project that uses: EBayesThresh
describes a project that uses: EMVS
MaRDI profile type: Publication
cites work: On optimality of Bayesian testimation in the normal means problem
cites work: Regularization of Wavelet Approximations
cites work: Dirichlet–Laplace Priors for Optimal Shrinkage
cites work: Simultaneous analysis of Lasso and Dantzig selector
cites work: Statistics for high-dimensional data. Methods, theory and applications.
cites work: Q4845386
cites work: The horseshoe estimator for sparse signals
cites work: Bayesian linear regression with sparse priors
cites work: Needles and straw in a haystack: posterior concentration for possibly sparse sequences
cites work: Prediction Via Orthogonalized Model Mixing
cites work: Ideal spatial adaptation by wavelet shrinkage
cites work: Q4203244
cites work: Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
cites work: Calibration and empirical Bayes variable selection
cites work: Detecting Differentially Expressed Genes in Microarrays Using Bayesian Model Selection
cites work: Spike and slab variable selection: frequentist and Bayesian strategies
cites work: Consistency of spike and slab regression
cites work: Needles and straw in haystacks: Empirical Bayes estimates of possibly sparse sequences
cites work: Empirical Bayes selection of wavelet thresholds
cites work: Q5658936
cites work: A unified approach to model selection and sparse recovery using regularized least squares
cites work: Asymptotically minimax empirical Bayes estimation of a sparse normal mean vector
cites work: Bayesian Variable Selection in Linear Regression
cites work: Bayesian variable selection with shrinking and diffusing priors
cites work: Posterior contraction in sparse Bayesian factor models for massive covariance matrices
cites work: EMVS: The EM Approach to Bayesian Variable Selection
cites work: The Spike-and-Slab LASSO
cites work: SLOPE is adaptive to unknown sparsity and asymptotically minimax
cites work: Q4864293
cites work: Sparsity and Smoothness Via the Fused Lasso
cites work: The horseshoe estimator: posterior concentration around nearly black vectors
cites work: The sparsity and bias of the LASSO selection in high-dimensional linear regression
cites work: The Adaptive Lasso and Its Oracle Properties
cites work: Regularization and Variable Selection Via the Elastic Net
full work available at URL: 17-aos1554
OpenAlex ID: W2788365376
description: scientific article; zbMATH DE number 6865116