A note on the applications of one primary function in deep neural networks

DOI10.1142/S0219691321500582OpenAlexW4200134383MaRDI QIDQ5097859

Zhong Li, Hengjie Chen

Publication date: 1 September 2022

Published in: International Journal of Wavelets, Multiresolution and Information Processing (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1142/s0219691321500582

zbMATH Keywords

interpolationapproximationmodulus of continuitydeep ReLU network

Mathematics Subject Classification ID

Neural networks for/in biological studies, artificial life and related topics (92B20) Neural nets applied to problems in time-dependent statistical mechanics (82C32) Artificial intelligence (68T99) Rate of convergence, degree of approximation (41A25) Approximation by other special function classes (41A30)

Uses Software

• ImageNet
• GNMT
• AlexNet

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• The ridge function representation of polynomials and an application to neural networks
• The approximation operators with sigmoidal functions
• Approximation by Ridge functions and neural networks with one hidden layer
• Neural network operators: constructive interpolation of multivariate functions
• Provable approximation properties for deep neural networks
• Degree of approximation by neural and translation networks with a single hidden layer
• Exponential convergence of the deep neural network approximation for analytic functions
• Nonlinear approximation and (deep) ReLU networks
• Approximating smooth functions by deep neural networks with sigmoid activation function
• Interpolation by neural network operators activated by ramp functions
• Error bounds for approximations with deep ReLU networks
• Universality of deep convolutional neural networks
• Universal approximation bounds for superpositions of a sigmoidal function
• New Error Bounds for Deep ReLU Networks Using Sparse Grids
• Deep ReLU Networks Overcome the Curse of Dimensionality for Generalized Bandlimited Functions
• A note on the expressive power of deep rectified linear unit networks in high‐dimensional spaces
• Sparse grids
• Approximation by superpositions of a sigmoidal function