ML-Driven Dynamic Task Scheduling for Heterogeneous Computing via Spatiotemporal Performance Prediction
Yeheng Jin, Xuejun Yu, Chao Lu, Jing Xia, Yuan Lü, Jinyang Yan · 2025
Heterogeneous computing platforms that integrate multiple accelerators (CPUs, GPUs, and NPUs) play a pivotal role in big data and artificial intelligence applications, but face critical challenges, including insufficient precision in performance monitoring and resource utilization imbalances caused by homogeneous scheduling strategies. This study proposes a self-tuning methodology combining eBPF-based fine-grained tracing with spatiotemporal performance prediction. The framework incorporates three key innovations: (i) a kernel-user space collaborative monitoring architecture employing eBPF instrumentation to acquire and preprocess system metrics as structured datasets; (ii) a hybrid CNN-LSTM model predicting performance bottlenecks under load surges through temporal pattern recognition; (iii) a PaddleLite-implemented dynamic scheduler enabling hardware-aware task allocation. Experimental validation using MobileNet-based object detection tasks demonstrates a 45% reduction in average per-frame inference latency and a balanced resource utilization improvement (CPU/GPU utilization increased by 13.3%/20.1% while alleviating NPU overload). The proposed approach provides an effective resource management solution for domestic heterogeneous computing ecosystems.