Horseshoe Regularisation for Machine Learning in Complex and Deep Models1

DOI10.1111/insr.12360arXiv1904.10939OpenAlexW3003423125MaRDI QIDQ6064351

Jyotishka Datta, Nicholas G. Polson, Anindya Bhadra, Yunfan Li

Publication date: 12 December 2023

Published in: International Statistical Review (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1904.10939

zbMATH Keywords

shrinkagenon-lineardeep learningnon-Gaussianlarge scale machine learningcomplex data

Mathematics Subject Classification ID

Linear inference, regression (62Jxx) Parametric inference (62Fxx) Statistical decision theory (62Cxx)

Related Items (2)

Some models are useful, but how do we know which ones? Towards a unified Bayesian model taxonomy ⋮ Discussion to: Bayesian graphical models for modern biological applications by Y. Ni, V. Baladandayuthapani, M. Vannucci and F.C. Stingo

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Achieving shrinkage in a time-varying parameter model framework
• Sparse inverse covariance estimation with the graphical lasso
• Conditions for posterior contraction in the sparse normal means problem
• MCMC maximum likelihood for latent state models
• Mean field variational Bayes for continuous sparse signal shrinkage: pitfalls and remedies
• The horseshoe estimator: posterior concentration around nearly black vectors
• Asymptotic properties of Bayes risk of a general class of shrinkage priors in multiple hypothesis testing under sparsity
• Asymptotic Bayes-optimality under sparsity of some multiple testing procedures
• Asymptotic properties of Bayes risk for the horseshoe prior
• Sparsistency and rates of convergence in large covariance matrix estimation
• Statistical decision theory and Bayesian analysis. 2nd ed
• Variable selection using shrinkage priors
• On the contraction properties of some high-dimensional quasi-posterior distributions
• The horseshoe+ estimator of ultra-sparse signals
• Asymptotic optimality of one-group shrinkage priors in sparse high-dimensional problems
• Uncertainty quantification for the horseshoe (with discussion)
• Needles and straw in haystacks: Empirical Bayes estimates of possibly sparse sequences
• Needles and straw in a haystack: posterior concentration for possibly sparse sequences
• Shrinkage estimation
• Lasso meets horseshoe: a survey
• GPU-accelerated Gibbs sampling: a case study of the horseshoe probit model
• High-dimensional graphs and variable selection with the Lasso
• Bayesian graphical Lasso models and efficient posterior computation
• On the half-Cauchy prior for a global scale parameter
• Inference with normal-gamma prior distributions in regression problems
• Joint High‐Dimensional Bayesian Variable and Covariance Selection with an Application to eQTL Analysis
• Computer Age Statistical Inference
• Posterior expectations for large observations
• Efficient Sampling for Gaussian Linear Regression With Arbitrary Priors
• Simultaneous Variable and Covariance Selection With the Multivariate Spike-and-Slab LASSO
• Bayesian Deep Net GLM and GLMM
• The horseshoe estimator for sparse signals
• Bayesian Variable Selection in Linear Regression
• Some matrix-variate distribution theory: Notational considerations and a Bayesian application
• Normal Variance-Mean Mixtures and z Distributions
• 10.1162/jmlr.2003.3.4-5.993
• The Spike-and-Slab LASSO
• EMVS: The EM Approach to Bayesian Variable Selection
• A Family of Minimax Estimators of the Mean of a Multivariate Normal Distribution
• Functional Horseshoe Priors for Subspace Shrinkage
• Stein's Estimation Rule and Its Competitors--An Empirical Bayes Approach
• Dynamic Shrinkage Processes
• Bayesian Analysis of Binary and Polychotomous Response Data
• Mixtures, Envelopes and Hierarchical Duality
• Prediction risk for the horseshoe regression
• Default Bayesian analysis with global-local shrinkage priors
• Bayesian inference on quasi-sparse count data
• Bayesian Inference for Logistic Models Using Pólya–Gamma Latent Variables
• Data augmentation for non-Gaussian regression models using variance-mean mixtures
• Proper Bayes Minimax Estimators of the Multivariate Normal Mean
• An Efficient Method of Estimating Seemingly Unrelated Regressions and Tests for Aggregation Bias
• The Graphical Horseshoe Estimator for Inverse Covariance Matrices
• Neuronized Priors for Bayesian Sparse Linear Regression

This page was built for publication: Horseshoe Regularisation for Machine Learning in Complex and Deep Models¹