Hierarchical Multiscale CNN With Frequency-Aware Attention for Enhanced HAR
Baruri Sai Avinash, Rahul Aryan, Abhishek Kumar Yadav, Vyom Kumar Gupta, Binod Kumar · IEEE Sensors Journal · 2025
Wearable Human Activity Recognition (HAR) has greatly benefited from deep convolutional neural networks. However, while increasing network width or depth improves accuracy, it also leads to higher resource consumption. This necessitates a balance between recognition accuracy and computational efficiency, especially for resource-constrained devices. To address this challenge, we propose a hybrid lightweight deep learning model that optimizes this trade-off. Our model integrates a Hierarchical Multiscale Convolutional Neural Network (HMCN) for efficient feature extraction and a Frequency-Based Attention Module (FBAM) for enhanced feature representation. To maximize effectiveness, we employ various spatial domain transformations to convert inertial sensor data into activity images, which are then processed by the HMCN-FBAM model. Evaluated on five benchmark datasets, our approach achieves state-of-the-art performance: an F1-score of 98.74% on UCI HAR (CWT), 99.00% on PAMAP2 (GAF), 96.87% on Opportunity (CWT), 98.53% on KU-HAR (CWT), and 96.94% on FLAAP (GAF). Moreover, compared to lightweight models and existing literature, our model not only delivers superior performance but also significantly reduces computational cost, requiring only 0.15M, 0.23M, 0.39M, 0.20M, and 0.31M parameters on the respective datasets.