A novel recurrent neural network of gated unit based on Euler's method and application
Pinchao Meng, Lin Wang, Weishi Yin, Linhua Zhou · Communications on Analysis and Computation · 2023
The main focus of this paper is to interpret the neural networks as the discretizations of differential equations, which has more benefits for analyzing the intrinsic mechanisms of neural networks. Under this theoretical framework, we propose a conditionally stable network unit called the GUEM, which is based on the Euler's method for ordinary differential equations and the gated thought in recurrent neural networks. Moreover, we build a sequence-to-sequence recurrent neural network based on the GUEM and fully connected layers, which does not amplify perturbations caused by noises of the input features. Finally, the numerical experiments of inverse scattering problems demonstrate the effectiveness and efficiency of our network.