A random matrix analysis of random Fourier features: beyond the Gaussian kernel, a precise phase transition, and the corresponding double descent*
From MaRDI portal
Publication:5020045
DOI10.1088/1742-5468/ac3a77OpenAlexW3098901286MaRDI QIDQ5020045
Michael W. Mahoney, Zhenyu Liao, Romain Couillet
Publication date: 3 January 2022
Published in: Journal of Statistical Mechanics: Theory and Experiment (Search for Journal in Brave)
Full work available at URL: https://arxiv.org/abs/2006.05013
Related Items (2)
Binary Classification of Gaussian Mixtures: Abundance of Support Vectors, Benign Overfitting, and Regularization ⋮ Benign Overfitting and Noisy Features
Uses Software
Cites Work
- Unnamed Item
- Rigorous learning curve bounds from statistical mechanics
- A random matrix approach to neural networks
- High-dimensional asymptotics of prediction: ridge regression and classification
- High-dimensional dynamics of generalization error in neural networks
- Just interpolate: kernel ``ridgeless regression can generalize
- Deterministic equivalents for certain functionals of large random matrices
- Statistical Mechanics of Learning
- Random Matrix Methods for Wireless Communications
- Information, Physics, and Computation
- On Random Matrices Arising in Deep Neural Networks. Gaussian Case
- The Generalization Error of Random Features Regression: Precise Asymptotics and the Double Descent Curve
- Benign overfitting in linear regression
- A model of double descent for high-dimensional binary linear classification
- Reconciling modern machine-learning practice and the classical bias–variance trade-off
- On the Equivalence between Kernel Quadrature Rules and Random Feature Expansions
- The elements of statistical learning. Data mining, inference, and prediction
This page was built for publication: A random matrix analysis of random Fourier features: beyond the Gaussian kernel, a precise phase transition, and the corresponding double descent*
