Some issues in dense linear algebra for multicore and special purpose architectures
Marc Baboulin, Jack J. Dongarra, Stanimire Z. Tomov · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) · 2008
Abstract. We address some key issues in designing dense linear alge-bra (DLA) algorithms that are common for both multi/many-cores and special purpose architectures (in particular GPUs). We present them in the context of an LU factorization algorithm, where randomization tech-niques are used as an alternative to pivoting. This approach yields an algorithm based entirely on a collection of small Level 3 BLAS type com-putational tasks, which has emerged as a common goal in designing DLA algorithms for new architectures. Other common trends, also considered here, are block asynchronous task execution and “Block ” layouts for the data associated with the separate tasks. We present numerical results and other specific experiments with DLA algorithms on NVIDIA GPUs using CUDA. The GPU results are also of interest themselves as we show a performance of up to 160 Glop/s on a single Quadro FX 5600 card.