Systematically extending a high-level code generator with support for tensor cores
Lukas Siefke, Bastian Köpcke, Sergei Petrovich Gorlatch, Michel Steuwer · 2022
High-level code generators like Halide, Lift, and RISE make a compelling proposition: write programs in a simple high-level language and get high-performing GPU code "for free". They achieve this feat by restricting the input language to a specific domain (such as image and array processing in Halide) or to a fixed set of flexible parallel patterns (as Lift and RISE do). Implementing high-level code generators that produce high-performance code is challenging, specifically as the target hardware constantly evolves.