AI Body Language Decoder using MediaPipe and Python
Sankeerthana Rajan Karem, Sai Prathyusha Kanisetti, K. Soumya, J. Sri Gayathri Seelamanthula, Madhurima kalivarapu · International journal of advance research, ideas and innovations in technology · 2021
Body language are visual languages produced by the movement of the hands, face and body. In this project we evaluate representations based on skeleton poses, as these are explainable, person-independent, privacy-preserving, low-Dimentional representations. Basically skeletal representations generalize over an individual’s appearance and background, allowing us to focus on the recognition of motion. We present a real-time on-device body tracking pipeline that predicts hand skeleton and the whole body notion. It is implemented via MediaPipe, a framework for building cross-platform ML solutions. We perform using pose estimation systems and analyze the applicability of the estimation systems to body language recognition by evaluating failure cases of the existing models. The proposed system and architecture demonstrates real-time inference and high prediction quality.