Removing Host Interventions from GPU Accelerated Neural Network
Jeong-Joon Yoo, Kyong-Joo Oh, Jaehee Jun, Hoonhee Cho, Kyeong Min Kim · 2023 IEEE International Conference on Consumer Electronics (ICCE) · 2023
In this paper, we present a novel scheme removing host interventions from OpenCL execution in GPU-accelerated neural network. Our scheme must satisfy two folds; i) remove host interventions between CPU and GPU interactions, ii) use previous OpenCL kernels without modification. To do so, we propose a Delegator-based OpenCL execution method providing a good solution in such situation. Experimental result shows that our scheme reduces execution latency into 0.43.