Applications of Transformer Attention Mechanisms in Information Security: Current Trends and Prospects
M. Vubangsi, Sarumi Usman Abidemi, Olukayode Akanni, Auwalu Saleh Mubarak, Fadi M. Al-Turjman · 2022
In this work, we present a comprehensive survey on applications of the most recent transformer architecture based on attention in information security. Our review reveals three primary areas of application: Intrusion detection, Anomaly Detection and Malware Detection. We have presented an overview of attention-based mechanisms and their application in each cybersecurity use case, and discussed open grounds for future trends in Artificial Intelligence enabled information security.