Dimensionality Reduction, Regularization, and Generalization in Overparameterized Regressions
DOI10.1137/20M1387821zbMath1493.62371arXiv2011.11477MaRDI QIDQ5065466
Soledad Villar, Ningyuan Huang, David W. Hogg
Publication date: 21 March 2022
Published in: SIAM Journal on Mathematics of Data Science (Search for Journal in Brave)
Full work available at URL: https://arxiv.org/abs/2011.11477
partial least squaresprincipal component analysislinear regressionprincipal component regressionadversarial attacksdouble descent
Factor analysis and principal components; correspondence analysis (62H25) Estimation in multivariate analysis (62H12) Classification and discrimination; cluster analysis (statistical aspects) (62H30) Linear regression; mixed models (62J05) Learning and adaptive systems in artificial intelligence (68T05)
Cites Work
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Concentration inequalities and moment bounds for sample covariance operators
- Normal approximation and concentration of spectral projectors of sample covariance
- On the interlacing property for singular values and eigenvalues
- On principal components regression, random projections, and column subsampling
- Partial least squares prediction in high-dimensional regression
- A paradox concerning nuisance parameters and projected estimating functions
- Comparison of Prediction Methods When Only a Few Components are Relevant
- A Statistical View of Some Chemometrics Regression Tools
- Generalization Error of Minimum Weighted Norm and Kernel Interpolation
- Triple descent and the two kinds of overfitting: where and why do they appear?*
- Two Models of Double Descent for Weak Features
- How to Reduce Dimension With PCA and Random Projections?
- The Exact Form of the “Ockham Factor” in Model Selection
- Benign overfitting in linear regression
- On the Adversarial Robustness of Subspace Learning
- Reconciling modern machine-learning practice and the classical bias–variance trade-off
- Robust PCA via Outlier Pursuit
- Advanced Lectures on Machine Learning
- A Paradoxical Result in Estimating Regression Coefficients
This page was built for publication: Dimensionality Reduction, Regularization, and Generalization in Overparameterized Regressions
