Effect of shapes of activation functions on predictability in the echo state network
Hanten Chang, Shinji Nakaoka, Ando, Hiroyasu · arXiv (Cornell University) · 2019
We investigate prediction accuracy for time series of Echo state networks with respect to several kinds of activation functions. As a result, we found that some kinds of activation functions with an appropriate nonlinearity show high performance compared to the conventional sigmoid function.