Characterization of the variation spaces corresponding to shallow neural networks
From MaRDI portal
Publication:6101230
DOI10.1007/s00365-023-09626-4arXiv2106.15002OpenAlexW4321492009MaRDI QIDQ6101230
Jonathan W. Siegel, Jin-Chao Xu
Publication date: 20 June 2023
Published in: Constructive Approximation (Search for Journal in Brave)
Full work available at URL: https://arxiv.org/abs/2106.15002
Learning and adaptive systems in artificial intelligence (68T05) Normed linear spaces and Banach spaces; Banach lattices (46B99)
Related Items
Two-layer networks with the \(\text{ReLU}^k\) activation function: Barron spaces and derivative approximation ⋮ Quadratic Neural Networks for Solving Inverse Problems
Cites Work
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- On the rate of convergence of greedy algorithms.
- A simple lemma on greedy approximation in Hilbert space and convergence rates for projection pursuit regression and neural network training
- Uniform approximation by neural networks
- Random approximants and neural networks
- Some remarks on greedy algorithms
- Approximation rates for neural networks with general activation functions
- Approximation and learning by greedy algorithms
- Greedy Approximation
- Lower bounds for the rate of convergence of greedy algorithms
- Integral combinations of Heavisides
- Greedy approximation
- Universal approximation bounds for superpositions of a sigmoidal function
- Degree of Approximation Results for Feedforward Networks Approximating Unknown Mappings and Their Derivatives
- Bounds on rates of variable-basis and neural-network approximation
- Comparison of worst case errors in linear and neural network approximation
- Approximation by Combinations of ReLU and Squared ReLU Ridge Functions With <inline-formula> <tex-math notation="LaTeX">$\ell^1$ </tex-math> </inline-formula> and <inline-formula> <tex-math notation="LaTeX">$\ell^0$ </tex-math> </inline-formula> Controls
- What Kinds of Functions Do Deep Neural Networks Learn? Insights from Variational Spline Theory
- Finite Neuron Method and Convergence Analysis
