Heterogeneous Computing Platform for Power-Performance Efficient On-Device AI
Jie Deng, Jun Yuan, Qingqing Liang, Cheng-Han Wu, Frank Yang, You-Seok Suh, Ritu Chaba, Jean-Francois Vidon, Raghava Denduluri, Giri Nallapati, P.R. Chidambaram · 2024
This paper explores the rapid growth of on-device AI and the crucial role of heterogeneous computing in addressing the increasing performance demands and power challenges of edge computing. Innovations in processor design and System-Technology-Co-Optimization (STCO), exemplified by the Snapdragon®8 Elite platform, have significantly enhanced performance and power efficiency. However, sustaining power-perf-cost efficiency as technology scales presents an ongoing challenge.