Performance of End-to-end Model Based on Convolutional LSTM for Human Activity Recognition

Young Ghyu Sun, Soo Hyun Kim, Seongwoo Lee, Joonho Seon, Sang-Woon Lee, Cheong Ghil Kim, Jin Young Kim · Journal of Web Engineering · 2022

Human activity recognition (HAR) is a key technology in many applications, such as smart signage, smart healthcare, smart home, etc. In HAR, deep learning-based methods have been proposed to recognize activity data effectively from video streams. In this paper, the end-to-end model based on convolutional long short-term memory (LSTM) is proposed to recognize human activities. Convolutional LSTM can learn features of spatial and temporal simultaneously from video stream data. Also, the number of learning weights can be diminished by employing convolutional LSTM with an end-to-end model. The proposed HAR model was optimized with various simulation environments using activities data from the AI hub. From simulation results, it can be confirmed that the proposed model can be outperformed compared with the conventional model.

Read the paper · More papers on PaperTik