SignReLU neural network and its approximation ability

DOI10.1016/j.cam.2023.115551arXiv2210.10264OpenAlexW4386893216MaRDI QIDQ6126040

Ding-Xuan Zhou, Jianfei Li, Han Feng

Publication date: 9 April 2024

Published in: Journal of Computational and Applied Mathematics (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/2210.10264

zbMATH Keywords

activation functionapproximation powerdeep neural networksSignReLU activation

Mathematics Subject Classification ID

Artificial neural networks and deep learning (68T07) Approximation by arbitrary nonlinear expressions; widths and entropy (41A46)

Cites Work

• Unnamed Item
• CMB data analysis and sparsity
• Optimal nonlinear approximation
• Approximation properties of a multilayered feedforward artificial neural network
• Approximation of functions from korobov spaces by deep convolutional neural networks
• Optimal approximation of piecewise smooth functions using deep ReLU neural networks
• Error bounds for approximations with deep ReLU networks
• Universality of deep convolutional neural networks
• Learning theory estimates via integral operators and their approximations
• Universal approximation bounds for superpositions of a sigmoidal function
• Deep distributed convolutional neural networks: Universality
• Approximation by Combinations of ReLU and Squared ReLU Ridge Functions With <inline-formula> <tex-math notation="LaTeX">$\ell^1$ </tex-math> </inline-formula> and <inline-formula> <tex-math notation="LaTeX">$\ell^0$ </tex-math> </inline-formula> Controls
• Optimal Approximation with Sparsely Connected Deep Neural Networks
• New Error Bounds for Deep ReLU Networks Using Sparse Grids
• Approximations with deep neural networks in Sobolev time-space
• Error bounds for approximations with deep ReLU neural networks in Ws,p norms
• Deep Network Approximation for Smooth Functions
• Deep Network Approximation Characterized by Number of Neurons
• Deep neural networks for rotation-invariance approximation and learning
• $L^\infty $-Multivariate Approximation Theory

This page was built for publication: SignReLU neural network and its approximation ability