Memory Reference Analysis and Implications for Executing AI Workloads in Mobile Systems
Seokmin Kwon, Hyokyung Bahn · 2023
Recently, mobile applications that internally execute artificial intelligence workloads are increasing. In mobile environments, performance degradation due to memory thrashing may occur while artificial intelligence workloads perform the training of large data set due to limitations in memory capacity. In this paper, we analyze the memory reference characteristics of artificial intelligence workloads, and observe that artificial intelligence workloads can cause performance degradation by generating a lot of I/Os (Inputs / Outputs) to NAND flash storage in mobile systems due to weak temporal locality and irregular popularity bias in memory write operations. Based on this observation, we discuss system architectures that can efficiently execute artificial intelligence workloads in mobile systems. Specifically, we adopt small persistent memory as write accelerator and show how efficiently the memory write operation of mobile systems can be managed. Simulation experiments show that the proposed system architecture can improve I/O time significantly compared to existing mobile systems.