Fine-grained address segmentation for attention-based variable-degree prefetching
Pengmiao Zhang, Ajitesh Srivastava, Anant Nori, Rajgopal Kannan, Viktor K. Prasanna · 2022
Machine learning algorithms have shown potential to improve prefetching performance by accurately predicting future memory accesses. Existing approaches are based on the modeling of text prediction, considering prefetching as a classification problem for sequence prediction. However, the vast and sparse memory address space leads to large vocabulary, which makes this modeling impractical. The number and order of outputs for multiple cache line prefetching are also fundamentally different from text prediction.