Memory requirements for balanced computer architectures
H. T. Kung · ACM SIGARCH Computer Architecture News · 1986
One particular result is that to balance an array of p linearly connected PEs for performing matrix computations such as matrix multiplication and matrix triangularization, the size of each PE's local memory must grow linearly with p . Thus, the larger the array is, the larger each PE's local memory must be.