Method for Generating Synthetic Images of Masked Human Faces

Maksim Letenkov, Roman Iakovlev, Maxim Markitantov, Dmitry Ryumin, Anton Igorevich Saveliev, Alexey Anatolievich Karpov · Scientific Visualization · 2022

This study is devoted to the topical problem of generating synthetic images of human faces.The paper presents a new method for generating images of human faces in protective masks.The proposed method is based on the combined use of a neural network method for detecting three-dimensional facial landmarks (3D-FAN) and three-dimensional modeling tools.Approbation and quality assessment of the proposed method was conducted on a test dataset, which includes 3836 images.The dataset included human faces images of different gender and age, taken at different distances and at various angles relatively to the camera lens.To assess generation results, the method of multi-criteria assessment was used with the involvement of an expert group.For each generated image final scores were formed by averaging the obtained ratings, both by criteria and by experts.During the experiment, the developed method has demonstrated a high and stable quality for the following ranges of face orientations [-20; +55], [-60; +60] and [-70; +80] along the OX, OY and OZ axes, respectively.The final proportion of correctly generated images of masked human faces turned out to be 95.9%.

Read the paper · More papers on PaperTik