Tensor Cores
Richard E. Ansorge · Cambridge University Press eBooks · 2022
This chapter discusses the tensor core hardware available on newer GPUs. This hardware is designed to perform fast mixed precision matrix multiplications and is intended for applications in AI. However, CUDA exposes their use to programmers with the warp matrix function library. These functions support tiled matrix multiplication using 16 × 16 tiles. We provide examples of their use to improve on the early matrix multiplication example in Chapter 2. We also show how reduction operations can be performed using tensor codes as a potential non-AI application.