Collectives and Communicators: A Case for Orthogonality
Jesper Larsson Träff, Sascha Hunold, Guillaume Mercier, Daniel J. Holmes · 2020
A major reason for the success of MPI as the standard for large-scale, distributed memory programming is the economy and orthogonality of key concepts. These very design principles suggest leaner and better support for stencil-like, sparse collective communication, while at the same time reducing significantly the number of concrete operation interfaces, extending the functionality that can be supported by high-quality MPI implementations, and provisioning for possible future, much more wide-ranging functionality.