Activation Control of Vision Models for Sustainable AI Systems
Jonathan Burton-Barr, Basura Fernando, Deepu Rajan · IEEE Transactions on Artificial Intelligence · 2024
As AI systems become more complex and widespread, they require significant computational power, increasing energy consumption. Addressing this challenge is essential for ensuring the long-term sustainability of AI technology. AI-on-AI control refers to a system with a set of AI functions controlled by an upper-level AI model. Previous work in AI-on-AI control focuses on boosting accuracy or expanding system capability by increasing overall system cost. Alternatively, we focus on applying AI-on-AI control to decrease system cost and increase the sustainability and viability of a system with multiple AI functions. Our Supervised Image Classification Evaluative Controller (SICEC) is a cost-reduction oriented AI-on-AI controller that learns when vision models within an AI system should be activated based on input features. The function controller preprocesses an input and activates relevant functions, functions being distinct units of AI functionality within the system. Some functions have a set of same functional models. These models take the same input and produce the same output but have architectural differences. We introduce a same functional controller to select a same functional model using the function controller’s decision confidence. Results are promising, with a decrease of up to 48.9% in inference time, 67.8% in FLOPs, and 66.4% in energy usage. With SICEC showing significant reductions in inference time and energy cost, our work contributes to limited resource computing and sustainable AI technology.