Performance Gains and Drawbacks using Set Associative Cache
Marjan Gušev, Sasko Ristov · Journal of Next Generation Information Technology · 2012
Abstract This paper explains why there are performance drawbacks for dense matrix multiplication algorithm using multilevel associative cache memory. We give an overview of cache memory organization and theoretical analysis why performance drawback appears in dense matrix multiplication algorithm. We also provide a method to avoid situations where this performance drawback is significant and how to achieve maximum performance. The analyzed problem appears in storage of matrix columns and inefficient usage of cache where the matrix will always map onto a small group of same cache sets and initiate a significant number of cache misses. In this case it looks like the processor is using only a small group of cache sets instead of complete number of sets in associative memory where maximum performance can be achieved.