Indoor Human Activity Recognition Using Multiple Dynamic Nonlinear Mapping Applied to 3-D LiDAR-Collected Data
Xiang Meng, Mondher Bouazizi, Zhaojie Li, Tomoaki Otsuki Ohtsuki · IEEE Internet of Things Journal · 2025
Activity recognition is essential in computer vision applications, such as smart homes and healthcare services. While RGB images have been widely used in this area, they pose challenges related to privacy invasion and environmental constraints. To address these issues, some research has explored using 3-D light detection and ranging (3-D LiDAR) to collect 3-D point cloud data for activity recognition. However, the high-computational cost and large model parameters required for processing 3-D point clouds remain major limitations. To overcome these challenges, we propose a novel multiclass activity recognition system based on skeleton extraction from depth images collected by 3-D LiDAR. First, we use 3-D LiDAR to collect depth images of ten distinct activities, such as walking, falling, and squatting. Next, we process these depth images using our proposed multiple dynamic nonlinear mapping (MDNLM) method. The MDNLM method enhances the clarity of human body details by adjusting the color distribution of depth values based on the human position, ensuring that more colors are allocated to specific regions of the human body. This enhancement allows a fine-tuned algorithm to extract skeleton joints accurately from the mapped images. Finally, the extracted skeletons are fed into a convolutional neural network combined with a long short-term memory network (CNN+LSTM) for multiclass activity recognition. Our proposed method achieved 100.0% accuracy for a 2-class classification task (fall detection), 99.0% accuracy for a 7-class classification task, and 94.7% accuracy for a 10-class classification task.