Realistic Sketch Face Generation via Sketch-Guided Incomplete Restoration
Zijie Liu, Chunhua Gu, Ying Xie, Huichen Zhang, Songwen Pei · 2023
Generating realistic sketches of human faces is an important research direction in the fields of computer vision and computer graphics. However, generating high-quality sketch faces remains challenging, especially when dealing with incomplete input sketch images. In this paper, we propose a framework based on the U-Net generative network, which progressively optimizes network performance through a three-stage training strategy. We introduce the Sketch Guidance and Completion Network (SGCN), which is capable of restoring missing features, completing blurry edges, and handling occluded regions in sketch images. By employing multiple discriminators and adversarial training strategies, we enhance the realism and preserve fine details in the generated results. Through experiments on publicly available sketch face datasets, we demonstrate significant improvements in reconstructing incomplete sketch faces using our approach. The generated images exhibit enhanced completeness, realism, and retain fine details and important facial features. Quantitative evaluations validate the effectiveness and superiority of our method.