Heaviside function as an activation function

DOI10.1515/JAA-2022-2012zbMath1518.41010OpenAlexW4307240558MaRDI QIDQ6112992

Isao Ishikawa, Naoya Hatano, Yoshihiro Sawano, Masahiro Ikeda

Publication date: 10 July 2023

Published in: Journal of Applied Analysis (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1515/jaa-2022-2012

zbMATH Keywords

neural networksuniform normHeaviside functionscàdlàg

Mathematics Subject Classification ID

Approximation by other special function classes (41A30)

Cites Work

• A global universality of two-layer neural networks with ReLU activations
• Neural network with unbounded activation functions is universal approximator
• Approximation by superpositions of a sigmoidal function
• Unnamed Item

This page was built for publication: Heaviside function as an activation function