A Review of Activation Function for Artificial Neural Network
Andrinandrasana David Rasamoelina, Fouzia Adjailia, Peter Sinčák · 2020
The activation function plays an important role in the training and the performance of an Artificial Neural Network. They provide the necessary non-linear properties to any Artificial Neural Network. In this work, we provide a review of the most common and recent activation functions used in the hidden layer of an artificial Neural Network.