Uniform approximation by neural networks
type: Item
instance of: scholarly article
title: Uniform approximation by neural networks
zbMATH Open document ID: 0932.41016
published in: Journal of Approximation Theory
publication date: 2000-03-08T00:00:00Z
review text: Let \(X\) be a Banach space, let \(\Phi \subset X\) be a bounded set, and let \(f=\sum_k c_k\phi_k\), \(\phi_k\in\Phi\), \(c_k\in {\mathbb R}\), where the sum can be finite or infinite or more generally, \(f\) can be of the form \(f=\int c_{\lambda}\phi_{\lambda}d\mu(\lambda)\), in an appropriate setting. Given a natural number \(n\), it is required to find a good approximation to \(f\) by a linear combination \(g_n =\sum_{i=1}^n a_i\phi_{k_i}\) of at most \(n\) of the \(\phi_k\). The author previously considered [J. Approximation Theory 41, 361-366 (1984; Zbl 0543.41027)] this problem for \(X=L_q(D)\), \(q<\infty\), where \(D\) is a compact set in \({\mathbb R^n}\), assuming that the set \(\Phi\) is bounded in \(L_{\infty}(D)\). In this paper, he obtains by probabilistic methods an estimate for \(\|f - g_n\|\) in the uniform norm (i.e. \(X=L_{\infty}(D)\)). Two main cases are considered: (1) where \(D\) is a finite set and (2) where the set \(\Phi\) is formed by the functions \(\phi_{v,b}(x)\colon=s(v\cdot x+b)\), where \(v\cdot x\) is the scalar product, \(v,x\in {\mathbb R^d}\), \(b\in {\mathbb R}\), and \(s\) is a fixed \({\mathbb R} \to{\mathbb R}\) function.
reviewed by: Saulius Norvidas
Mathematics Subject Classification ID: 41A30
Mathematics Subject Classification ID: 41A46
Mathematics Subject Classification ID: 41A65
Mathematics Subject Classification ID: 41-02
zbMATH DE Number: 1230422
zbMATH Keywords: neural networks
zbMATH Keywords: target function
zbMATH Keywords: activation function
zbMATH Keywords: independent random variables
author: Yuly Makovoz
MaRDI profile type: Publication
full work available at URL: jath.1997.3217
OpenAlex ID: W2026307262
cites work: Universal approximation bounds for superpositions of a sigmoidal function
cites work: Decomposition theorems and approximation by a “floating" system of exponentials
cites work: Nonlinear approximation by trigonometric sums
cites work: Q3843987
cites work: Q4320142
cites work: On trigonometric n-widths and their generalization
cites work: Random approximants and neural networks
cites work: Q3952642
cites work: On the Uniform Convergence of Relative Frequencies of Events to Their Probabilities
cites work: Lower Bounds for Approximation by Nonlinear Manifolds
cites work: Sup-norm approximation bounds for networks through probabilistic methods
DOI: 10.1006/JATH.1997.3217
Recommended article: Sur certains systèmes d'équations fonctionnelles et l'approximation des fonctions continues.
Recommended article: Q3973222
Recommended article: On approximation of functions of two variables by sums of the form \(\varphi (x) + \psi (y)\) in \(L_ p\) spaces \((1\leq p\leq\infty )\)
Recommended article: Bounding separable recourse functions with limited distribution information
Recommended article: Q3723050
Recommended article: Q3768080
Recommended article: Necessary conditions for uniqueness in \(L^ 1\)-approximation
Recommended article: Q5463233
Recommended article: Summability approximation theorems of double random variables
Recommended article: Approximation properties of some means of Fourier series
description: scientific article; zbMATH DE number 1230422