Signing in the Air by Pinching Multi-Fingers for Advanced Authentication on Embedded System
Shih‐Hsiung Lee, I‐Cheng Chen, Hsuan-Chih Ku · 2023 IEEE International Conference on Consumer Electronics (ICCE) · 2023
The behavior of air signature does not require paper and pen. However, in the absence of visual feedback and stroke order information, it increases the difficulty of identifying the trajectory of air signatures. At the same time, the air signature is more difficult to forge. This paper proposes a novel, contactless and advanced authentication method. When the user signs in the air, we use the camera to capture the image data. Furthermore, MediaPipe is adopted on an embedded system to capture finger trajectories. The user uses 4 different pinching fingers methods as the pen action for starting to sign. Different combinations of the 4 different pinching fingers represent a password combination. Therefore, the trajectory of the signature in the air has the characteristics of a password. In this paper, the dynamic time warping (DTW) algorithm is used to compare the similarity between the current signature and the registered signature. Experiments show that the in-the-air signature mechanism of the implicit password through the combination of pinching fingers can effectively and quickly reject forged signature in the early stage of verification. In addition, this paper has the execution performance of 30 frame per second (fps) on the Jetson Xavier NX developed by Nvidia, which has the commercial value of low power consumption and low cost to meet the needs of the consumer market.