A Quantitative Study of Deep Learning Training on Heterogeneous Supercomputers
Jingoo Han, Luna Xu, M. Mustafa Rafique, Ali Raza Butt, Seung–Hwan Lim · 2019
The following topics are dealt with: parallel processing; storage management; learning (artificial intelligence); resource allocation; scheduling; computer centres; multiprocessing systems; graphics processing units; neural nets; message passing.