Distributed algorithm to train neural networks using the Map Reduce paradigm
Cristian Mihai Bârcă, Claudiu Dan Bârcă · RePEc: Research Papers in Economics · 2017
With rapid development of powerful computer systems during past decade, parallel and distributed processing becomes a significant resource for fast neural network training, even for real-time processing. Different parallel computing based methods have been proposed in recent years for the development of system performance. The two main methods are to distribute the patterns that are used for training - training set level parallelism, or to distribute the computation performed by the neural network - neural network level parallelism. In the present research work we have focused on the first method.