Supporting Deaf and Hard-of-Hearing People to Watch Sports by Detecting Excitement using Mobile and Wearable Devices

Hayato Fukui, Jee‐Eun Kim, Masahiro Bessho · 2022 IEEE 11th Global Conference on Consumer Electronics (GCCE) · 2022

In this paper, we propose an application for supporting deaf and hard-of-hearing (DHH) people to watch sports by detecting excitement. The application detects a crowd cheering sound with a machine learning technique and notifies it using mobile and wearable devices. We implemented a prototype of our proposed application using a commercially available smartphone and a smartwatch. We then conducted two experiments to evaluate the accuracy of excitement detection. The results demonstrated that our trained model could detect the level of excitement with a practical accuracy, showing the feasibility of our approach in supporting for DHH people to enjoy sport events.

Read the paper · More papers on PaperTik