Enhancing the Realism of Sketch and Painted Portraits With Adaptable Patches

Yuan-Heng Lee, Yu‐Kai Chang, Yu‐Lun Chang, I‐Chen Lin, Yu-Shuen Wang, Wen‐Chieh Lin · Computer Graphics Forum · 2017

Abstract Realizing unrealistic faces is a complicated task that requires a rich imagination and comprehension of facial structures. When face matching, warping or stitching techniques are applied, existing methods are generally incapable of capturing detailed personal characteristics, are disturbed by block boundary artefacts, or require painting‐photo pairs for training. This paper presents a data‐driven framework to enhance the realism of sketch and portrait paintings based only on photo samples. It retrieves the optimal patches of adaptable shapes and numbers according to the content of the input portrait and collected photos. These patches are then seamlessly stitched by chromatic gain and offset compensation and multi‐level blending. Experiments and user evaluations show that the proposed method is able to generate realistic and novel results for a moderately sized photo collection.

Read the paper · More papers on PaperTik