Neural Network Pruning and Pruning Parameters
Georg Thimm, Emile Fiesler · 1996
The default multilayer neural network topology is a fully interlayer connected one. This simplistic choice facilitates the design but it limits the performance of the resulting neural networks. The best-known methods for obtaining partially connected neural networks are the so called pruningmethods which are used for optimizing both the size and the generalization capabilities of neural networks. Two of the most promising pruning techniques have therefore been selected for a comparative study. It is shown that these novel techniques are hampered by having numerous user-tunable parameters, which can easily nullify the benefits of these advanced methods. Finally, based on the results, conclusions about the execution of experiments and suggestions for conducting future research on neural network pruning are drawn. KeyW ords---neural network, pruning, parameters, neural network optimization, network size, generalization INTRODUCTION Various neural network pruning techniques have been deve...