Precise digital implementations of hyperbolic tanh and sigmoid function
Shaghayegh Gomar, Mitra Mirhassani, Majid Ahmadi · 2016
Sigmoid and Hyperbolic Tangent are widely used as activation functions in artificial neural networks. Exponential term and division are basic building blocks of these functions. This paper proposes precise and efficient hardware implementations for sigmoid and hyperbolic tangent functions using exponential function approximation. Performance of both functions has been verified which shows that the proposed implementations have up to 99.97% similarity with the ideal transfer functions while the circuits take maximum 2% of logic resources when implemented on a Vertex IV FPGA.