Comparing Deep Learning and Human Crafted Features for Recognising Hand Activities of Daily Living from Wearables

Eleni Diamantidou, Dimitrios Giakoumis, Konstantinos Votis, Dimitrios K. Tzovaras, SPIRIDON D. LIKOTHANASSIS · 2022 23rd IEEE International Conference on Mobile Data Management (MDM) · 2022

This work presents a comparative analysis of human-crafted and automated feature extraction approaches for the discrimination of hand-based activities among eating, drinking and smoking. In this scheme, accelerometer and gyroscope sensors were utilised to capture activity signals. For this reason, wearable devices that embed the aforementioned sensors were employed to collect activity data from 12 office workers. The two approaches that were developed for feature mapping were evaluated equally on the collected dataset. Both the proposed schemes achieved to classify the hand-based activities. However, based on the experimental process, this study shows that the human-crafted features that extracted valuable information from the time and frequency domain of the raw signal measurements outperformed the automated feature mapping that utilised deep learning advances. The relevant results prove that the human-crafted features can recognise hand-based activities with 0.9109 and, on the other hand, automated features with a 0.907 F1 weighted score over the dataset.

Read the paper · More papers on PaperTik