Human Pose Estimation Using Skeletal Heatmaps
Jinyoung Jun, Jae-Han Lee, Chang‐Su Kim · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference · 2020
We propose a novel skeletal attention module to generate keypoint heatmaps, which exploits skeletal, as well as overall body structure, information for human pose estimation. We first add augmenting convolutional layers to an existing deep neural network in order to yield skeletal heatmaps. These skeletal heatmaps emphasize keypoint relations connected either physically or virtually. By combining the skeletal heatmaps, we generate body attention maps for upper-body, lower-body, and full-body. Then, the skeletal heatmaps and the body attention maps are employed to estimate the heatmap for each keypoint. Finally, we perform weighted inference on the output heatmaps for more precise estimates. Experimental results demonstrate that the proposed algorithm enhances performance on two datasets for human pose estimation.