Kernel Aware Warp Scheduler
Sen-Chih Tsai, Yu-Xiang Su, Y.C. Chin, Wei-Zhong Ceng, Chung‐Ho Chen · 2018
Observing that thread blocks of different kernels that use different functional units should be sent to the same SM (Streaming Multiprocessor) to promote the utilization of functional units, we propose a kernel-aware warp scheduler for GPGPUs. The proposed Kernel Aware Warp Scheduler uses the profiling information of the executed kernels to issue instructions from the right warp. The experimental results based on our HSAIL simulation platform show that the overall performance of the kernel execution improves by about 20% on average. The speedup comes from the increased utilization of functional units and effectiveness in hiding of the memory latency due to the proposed warp scheduling policy.