Coarse-Grain Load Distribution in Heterogeneous Computing
Alonso, Fernando, Arturo González Escribano, Torres, Yuri, Diego R. Llanos · UVaDOC UVaDOC University of Valladolid Documentary Repository (University of Valladolid) · 2019
HPC heterogeneous clusters are composed by different type of machines (various types of component manufacturers, varying computational capacities), and different hardware accelerators. TThe most common type of data distributions is the equal division of the data across all the nodes. A more sophisticated policy of data distribution is needed to explode the computational capacity of the entire system.