Issues in scalable library design for massively parallel computers
Lionel Ming-shuan Ni, Hong Xu, Edgar T. Kalns · 1993
This paper examines some crtttcal tssues raised in the design of libraries for MPCS, such as scalability, portability, recompilation, and flexibility.we adUocate a layered structure of it brary design, comprising a high-level language layer, a machine-independent node layer, a machine-dependent node layer, and an object code layer for diflerent demands and requirements.We discuss the impact of various data decomposition strategies on program performance and the computation and communication analysts techniques employed at different layers.We also propose the concept of the range of scalability as a metric for selectzng the most appropriate implementation.A linear system solver based on the Gaussian elimination method is used as an example to illustrate various design alternates.nessee and Oak Ridge National Laboratory attempts to provide a scalable LAPACK package for dense and banded matrix computations [3].The ComPaSS library being developed at Michigan State University attempts to provide a set of scalable communication