The Construction and Approximation of ReLU Neural Network Operators
Hengjie Chen, Dansheng Yu, Zhong Li · Journal of Function Spaces · 2022
In the present paper, we construct a new type of two-hidden-layer feedforward neural network operators with ReLU activation function. We estimate the rate of approximation by the new operators by using the modulus of continuity of the target function. Furthermore, we analyze features such as parameter sharing and local connectivity in this kind of network structure.