On the Estimation and Prediction Errors of Function Representation with Orthonormal Discrete Variable Basis in Regression Model.
Taichi Hayasaka, Katsuyuki Hagiwara, Naohiro Toda, Shiro Usui · The Brain & Neural Networks · 1997
One of the most important features of 3-layered neural networks is the adaptability of the basis functions. In this paper, in order to focus on the adaptability in a context of the regression or curve-fitting, we restricted our attention to function representation in which the basis functions are modified according to the associated discrete parameters. For such function representation, we derived the expectations of the least square error and prediction square error with respect to the distribution of a set of samples using the extreme value theory, provided that the given set of samples is an independent Gaussian noise sequence and the basis functions satisfy an appropriate orthonormality condition.