Evaluating Deep Learning Models for Posture and Movement Recognition During the ABCDE Protocol in Nurse Education
Matthias Tschöpe, Stefan Gerd Fritsch, David Habusch, Vítor Fortes Rey, Agnes Gruenerbl, Paul Lukowicz · 2024
This work focuses on body posture recognition and motion detection within a self-recorded video dataset, specifically designed for nurse education concerning the ABCDE emergency protocol. We evaluate three categories of methods. The first category relies on 2D pose data extracted for each nurse from the videos. To classify the body postures and motions, we use either handcrafted features derived from the skeleton data or features that are automatically learned through convolutional neural networks (CNNs). The second category of models employs CNNs to recognize body postures and motions directly from the video data, without relying on skeleton data. In the third category, we apply our designed 1D-CNN to CLIP image embed dings that are extracted from the videos. The work concludes with a comprehensive evaluation and comparison of all the models presented. The code and data are available at11https://github.com/matthias-tschoepe/Nurse_BodyPostures