On stability issues in deriving multivariable regression models

DOI10.1002/bimj.201300222zbMath1329.62035OpenAlexW1546527209WikidataQ41697552 ScholiaQ41697552MaRDI QIDQ3451367

Harald Binder, Anika Buchholz, Anne-Laure Boulesteix, Willi Sauerbrei

Publication date: 16 November 2015

Published in: Biometrical Journal (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1002/bimj.201300222

zbMATH Keywords

variable selectionmodel stabilitybootstrap resamplinginfluential pointregression model

Mathematics Subject Classification ID

Directional data; spatial statistics (62H11) Linear regression; mixed models (62J05) Applications of statistics to biology and medical sciences; meta analysis (62P10) Bootstrap, jackknife and other resampling methods (62F40)

Related Items

A novel bagging approach for variable ranking and selection via a mixed importance measure ⋮ PBoostGA: pseudo-boosting genetic algorithm for variable ranking and selection ⋮ Detection of influential points as a byproduct of resampling-based variable selection procedures ⋮ Variable selection – A review and recommendations for the practicing statistician ⋮ IPF-LASSO: integrative \(L_1\)-penalized regression with penalty factors for prediction based on multi-omics data ⋮ Subsampling versus bootstrapping in resampling-based model selection for multivariable regression ⋮ Handling co-dependence issues in resampling-based variable selection procedures: a simulation study ⋮ Pruning variable selection ensembles ⋮ Exploration of the variability of variable selection based on distances between bootstrap sample results ⋮ Visualization and assessment of model selection uncertainty

Uses Software

• rms
• party

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Bagging predictors
• To explain or to predict?
• Regression with linear predictors. With 171 illustrations by Therese Graversen.
• Boosting ridge regression
• On properties of predictors derived with a two-step bootstrap model averaging approach -- a simulation study in the linear regression model
• Bootstrap methods: another look at the jackknife
• Bayesian model averaging: A tutorial. (with comments and a rejoinder).
• Least angle regression. (With discussion)
• Forward stagewise regression and the monotone lasso
• Pitfalls of hypothesis tests and model selection on bootstrap samples: Causes and consequences in biometrical applications
• Adapting Prediction Error Estimates for Biased Complexity Selection in High-Dimensional Bootstrap Samples
• Estimating the Error Rate of a Prediction Rule: Improvement on Cross-Validation
• Multivariable Model‐Building
• The Bayesian Lasso
• Two graphical displays for outlying and influential observations in regression
• The Little Bootstrap and Other Methods for Dimensionality Selection in Regression: X-Fixed Prediction Error
• Regressions by Leaps and Bounds
• The Use of Resampling Methods to Simplify Regression Models in Medical Statistics
• Model Selection: An Integral Part of Inference
• Boosting With theL₂Loss
• Shrinkage and Penalized Likelihood as Methods to Improve Predictive Accuracy
• The practical utility of incorporating model selection uncertainty into prognostic models for survival data
• Regression modeling strategies. With applications to linear models, logistic regression and survival analysis
• Recent developments in bootstrap methodology