Former-HGR: Hand Gesture Recognition With Hybrid Feature-Aware Transformer
Monu Verma, Garvit Gopalani, Saiyam Bharara, Santosh Kumar Vipparthi, Subrahmanyam Murala, Mohamed Saeed Abdel-Mottaleb · IEEE Sensors Letters · 2025
Hand Gesture Recognition (HGR) systems, using cameras and sensors, offer an intuitive method for human-machine interaction, sparking interest across various applications. However, these systems face challenges from environmental factors like variations in illumination, complex backgrounds, diverse hand shapes, and similarities between different gesture classes. Achieving accurate gesture recognition under such conditions remains a complex task, necessitating robust solutions to ensure reliable performance. This letter proposes a novel approach named Former-HGR, a hybrid feature-aware transformer for HGR. Unlike traditional transformer-based HGR systems that heavily rely on computationally intensive self-attention mechanisms, Former-HGR enhances global feature perception by applying self-attention across channels through the integration of Multi-Dconv Head Transposed Attention (MDTA). Additionally, Former-HGR improves feature extraction by incorporating multi-scale features and effectively filters redundant information using a Hybrid Feature-Aware Network (HFAN). Extensive experiments conducted on three data sets: NUSII, OUHANDS, and MUGD, demonstrate that Former-HGR outperforms recent benchmark HGR approaches, achieving accuracy improvements of up to 14% in person-independent validation schemes.