Boosting the Performance of Weakly-Supervised 3d Human Pose Estimators With Pose Prior Regularizers
Lawrence Amadi, Gady Agam · 2022 IEEE International Conference on Image Processing (ICIP) · 2022
This work aims to boost the performance of 3D human pose estimators trained in a weakly-supervised setting where there are much fewer annotated 3D poses than unlabeled video data. We formulate two self-supervised pose prior regularizers (PPR) - bone proportion and joint mobility constraints that are pose translation, scale, and rotation invariant. These regularizers, combined with bone symmetry loss, reduce overfitting to the 2D reprojection loss commonly used in weakly-supervised settings by optimizing the bone lengths and joint rotations of estimated 3D poses. Consequently, improving the accuracy of 3D pose estimators. The regularizers are network independent and can be applied to any network architecture without modifications. We apply our proposed PPR to VideoPose3D network [1] and show that it decreases the MPJPE by 24% when using ≤5% of annotated H36M [2] 3D data, improving state-of-the-art accuracy by 7.9 mm.