PARALLELISM IN NEURAL NETS
David Al-Dabass, Prasad Vindlacheruvu, David J. Evans · International Journal of Parallel Emergent and Distributed Systems · 1997
This paper examines the structure of artificial neural networks (ANN) and the operation of their algorithms in order to identify the forms of parallelism that may be inherent in them. Parallelism within the topological structure of ANNs are seen to be of two forms: neuron and synapse. Operational parallelism is also of two forms: training set parallelism and recall/teaching parallelism. Performance models are formulated to predict the likely speed improvement achieved due to parallelism.