Crop: An Analytical Cost Model for Cross-Platform Performance Prediction of Tensor Programs
Xinyu Sun, Yu Zhang, Shuo Liu, Yi Zhai · 2024
Learn-based cost models used for tensor compiler auto-tuning often suffer from poor performance when trained on one hardware platform and applied to another. This issue necessitates collecting performance data for each potential platform during model deployment, incurring significant overhead.