Fast and efficient automatic memory management for GPUs using compiler-assisted runtime coherence scheme
Sreepathi Pai, R. Govindarajan, Matthew Jacob Thazhuthaveetil · 2012
Exploiting the performance potential of GPUs requires managing the data transfers to and from them efficiently which is an error-prone and tedious task. In this paper, we develop a software coherence mechanism to fully automate all data transfers between the CPU and GPU without any assistance from the programmer. Our mechanism uses compiler analysis to identify potential stale accesses and uses a runtime to initiate transfers as necessary. This allows us to avoid redundant transfers that are exhibited by all other existing automatic memory management proposals.