Parallel Backpropagation Neural Network Training Techniques using Graphics Processing Unit
Muhammad Arslan Amin, Muhammad Kashif, Muhammad Umer, Abdur Rehman, Fiaz Waheed, Haseeb Ur Rehman · International Journal of Advanced Computer Science and Applications · 2019
Training of artificial neural network using back-propagation is a computational expensive process in machine learning. Parallelization of neural networks using Graphics Pro-cessing Unit (GPU) can help to reduce the time to perform computations. GPU uses a Single Instruction Multiple Data (SIMD) architecture to perform high speed computing. The use of GPU shows remarkable performance gain when compared to CPU. This work discusses different parallel techniques for the backpropagation algorithm using GPU. Most of the techniques perform comparative analysis between CPU and GPU.