Exploiting inter-file access patterns using multi-collective I/O
Gokhan Memik, Mahmut Kandemir, Alok Choudhary · 2002
I/O (MCIO) that extends conventional collective I/O to optimize I/O accesses to multiple arrays simultaneously. In this approach, as in collective I/O, multiple processors co-ordinate to perform I/O on behalf of each other if doing so improves overall I/O time. However, unlike collective I/O, MCIO considers multiple arrays simultaneously; that is, it has a more global view of the overall I/O behavior exhibited by application. This paper shows that determining optimal MCIO access pattern is an NPcomplete problem, and proposes two different heuristics for the access pattern detection problem (also called the assignment problem).