Simultaneous Multi-face Zoom Tracking for 3-D People-Flow Analysis with Face Identification
Liheng Shen, Shaopeng Hu, Kohei Shimasaki, Taku Senoo, Idaku Ishii · 2020
We developed a dual-camera-based multi-face zoom-tracking system that captures zoomed targets simultaneously by combining a mirror-drive pan-tilt camera with ultrafast gaze control for zoomed views and an RGB-D camera for 3D wide view. In our system, the RGB-D camera detects multiple persons in the wide view and outputs the 3-D positions of their keypoints with CNN-based pose estimation. The mirror-drive pan-tilt camera simultaneously switches its viewpoints to the directions of the nose keypoints to zoom on their face images to perform person identification. We demonstrate our system performance using experimental results of a 3-D people-flow analysis with person identification, where the mirror-drive pantilt camera with 120-viewpoints/s-switching functions effectively as five virtual 24-fps pan-tilt cameras to track and zoom on the faces of five walking persons in an indoor scene.