GestureSet: Public Domain Dataset for Human Gesture Recognition using Wrist-worn Devices: A Preliminary Version
Pantelis Tzamalis, Sotiris Nikoletseas, Paul G. Spirakis · 2023
Human Gesture Recognition (HGR) has become an increasingly important research area in recent years, driven by the need for more natural and intuitive ways of interacting with machines. Wearable smart devices, such as smartwatches, smart wristbands, and other wrist-worn devices have the potential to enable accurate and efficient gesture recognition in real-world settings. However, equivalent problems, such as object detection in computer vision and audio identification in audio analysis, have obtained enormous advantages from comprehensive datasets over the last years, for instance, ImageNet and AudioSet, accordingly. This paper proposes the structure and the creation of a preliminary version of GestureSet, an HGR large-scale multitask dataset, which includes manually annotated data of gesture events that were collected from wrist-worn devices. In particular, it proposes a hierarchy abstraction schema for the proper dataset structure and instantiates the basis of the dataset through the first HGR task that is related to the collection and annotation of gestures related to allergic rhinitis identification. Thus, through this preliminary version, we describe how the proper dataset structure is divided into different groups, each one including sessions, individual gestures, and pilot data that could be used for evaluating the learning algorithms' performance in real-world scenarios. To the best of our knowledge, this is the first attempt that envisions a unified dataset for various HGR tasks that can find applications in different domains. Our vision, specifically, is for this work to set the basis for the dataset enrichment in a wide range of various tasks, and its data to be used in multiple learning and identification settings, providing circularity in different domains, and enabling reproducibility of the dataset's gestures events.