Eigenvalue distribution of some nonlinear models of random matrices

DOI10.1214/21-EJP699zbMath1483.15028arXiv1904.03090OpenAlexW4206109417MaRDI QIDQ2076620

Sandrine Péché, Lucas Benigni

Publication date: 22 February 2022

Published in: Electronic Journal of Probability (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1904.03090

zbMATH Keywords

neural networksrandom matricesmachine learning

Mathematics Subject Classification ID

Random matrices (probabilistic aspects) (60B20) Random matrices (algebraic aspects) (15B52) Neural nets and related approaches to inference from stochastic processes (62M45)

Related Items

Right large deviation principle for the top eigenvalue of the sum or product of invariant random matrices ⋮ Large-dimensional random matrix theory and its applications in deep learning and wireless communications ⋮ A note on the Pennington-Worah distribution

Uses Software

• ImageNet
• GNMT
• AlexNet
• dnner
• lsd

Cites Work

• Kernel spectral clustering of large dimensional data
• Singular values of products of Ginibre random matrices, multiple orthogonal polynomials and hard edge scaling limits
• The spectrum of kernel random matrices
• Identities from weighted Motzkin paths
• Spectral analysis of large dimensional random matrices
• A random matrix approach to neural networks
• The spectral norm of random inner-product kernel matrices
• On the empirical distribution of eigenvalues of a class of large dimensional random matrices
• Products of many large random matrices and gradients in deep neural networks
• Freeness over the diagonal for large random matrices
• A note on the Pennington-Worah distribution
• Raney distributions and random matrix theory
• THE SPECTRUM OF RANDOM INNER-PRODUCT KERNEL MATRICES
• Spectral analysis of the Gram matrix of mixture models
• Universal microscopic correlation functions for products of independent Ginibre matrices
• COMBINATORIAL PROBLEMS IN THE THEORY OF GRAPHS. III
• Correlation kernels for sums and products of random matrices
• Deep Neural Networks with Random Gaussian Weights: A Universal Classification Strategy?
• Nonlinear random matrix theory for deep learning
• Entropy and mutual information in models of deep neural networks*

This page was built for publication: Eigenvalue distribution of some nonlinear models of random matrices