Optimization Techniques in Artificial Intelligence: A Short Survey
Sanjay Goswami, Prithwish Sarkar · 2024
The field of Artificial Intelligence (AI) is fundamentally the problem of optimizing the learning models.An AI system is expected to learn autonomously from the data, encoding the real life scenarios, and optimize the learning models to reduce prediction errors.This paper offers a concise exploration of prominent optimization techniques employed across the diverse landscape of AI.We explore both the gradient-based and derivative-free methods, illuminating their strengths and limitations within the context of various AI applications.Additionally, we explore recent advancements in optimization techniques tailored for specific AI subfields and showcase realworld applications that leverage these techniques to achieve intelligent behavior.