Stable recovery of entangled weights: towards robust identification of deep neural networks from minimal samples
type: Item
instance of: scholarly article
title: Stable recovery of entangled weights: towards robust identification of deep neural networks from minimal samples
author: Ch. Fiedler
author: Massimo Fornasier
author: Timo Klock
author: Michael Rauchensteiner
published in: Applied and Computational Harmonic Analysis
publication date: 2022-12-08T00:00:00Z
full work available at URL: https://arxiv.org/abs/2101.07150
Mathematics Subject Classification ID: 68-XX
Mathematics Subject Classification ID: 92-XX
zbMATH DE Number: 7628776
zbMATH Keywords: deep neural networks
zbMATH Keywords: active sampling
zbMATH Keywords: exact finite sample identifiability
zbMATH Keywords: deparametrization
zbMATH Keywords: frames
zbMATH Keywords: nonconvex optimization on matrix spaces
describes a project that uses: Tensor2Tensor
describes a project that uses: AlexNet
describes a project that uses: WaveNet
describes a project that uses: ImageNet
MaRDI profile type: Publication
OpenAlex ID: W3124853521
cites work: Q5433140
cites work: Learning deep linear neural networks: Riemannian gradient flows and convergence to global minimizers
cites work: Q5037569
cites work: Identifying linear combinations of ridge functions
cites work: Robust principal component analysis?
cites work: Approximation by Ridge functions and neural networks with one hidden layer
cites work: A deep network construction that adapts to intrinsic dimensionality beyond the domain
cites work: Nonlinear approximation and (deep) ReLU networks
cites work: Neural network approximation
cites work: DNN expression rate analysis of high-dimensional PDEs: application to option pricing
cites work: Reconstructing a neural net from its output
cites work: Robust and resource-efficient identification of two hidden layer neural networks
cites work: Learning functions of few arbitrary linear parameters in high dimensions
cites work: Robust and resource efficient identification of shallow neural networks by fewest samples
cites work: Guaranteed Recovery of One-Hidden-Layer Neural Networks via Cross Entropy
cites work: Q4328459
cites work: On the complexity of loading shallow neural networks
cites work: Entropy and sampling numbers of classes of ridge functions
cites work: Function approximation by deep networks
cites work: Deep vs. shallow networks: an approximation theory perspective
cites work: Optimal approximation of piecewise smooth functions using deep ReLU neural networks
cites work: Approximation by Ridge Functions and Neural Networks
cites work: Provable approximation properties for deep neural networks
cites work: Understanding Machine Learning
cites work: Theoretical Insights Into the Optimization Landscape of Over-Parameterized Shallow Neural Networks
cites work: Q4614113
cites work: High-Dimensional Probability
cites work: Memory Capacity of Neural Networks with Threshold and Rectified Linear Unit Activations
cites work: Neural network identifiability for a family of sigmoidal nonlinearities
cites work: Affine symmetries and neural network identifiability
cites work: Perturbation bounds in connection with singular value decomposition
DOI: 10.1016/J.ACHA.2022.08.002
description: scientific article; zbMATH DE number 7628776