Content-aware image editing based on interpolation methods

Dong Wang · 2012

Image editing, as a fundamental tool for image processing, has been widely applied in fields such as computer animation, film making and photography. Among a variety of image editing patterns, color transfer, image retargeting and image composition are three hot spots attracting much attention in recent years. However, all of them have to face the problem of how to trade off between preserving image contents and satisfying new requirements so as to generate new images of high quality. Essentially, all these topics can be reduced to an optimization problem under some specified constraints. We study them from the viewpoint of data interpolation and propagation in a content-aware manner. It results in four novel content-aware and interpolation based methods for addressing these problems. Specifically, our main contributions can be summarized as follows: (1) We investigate the efficiency issue of color transfer based on edit propagation. Instead of solving an optimization equation, we renew the color attributes of each pixel in the original image according to those in the specified strokes using approximation mean value coordinates, which is a closed-form solution and can achieve instant feedback. Furthermore, we introduce an optimization equation to ensure that the specified strokes in the original image can preserve their shape well even if the structured information of the original strokes and the corresponding reference strokes is unmatched. The solution is still efficient due to the fact that the number of unknown variables (the pixels in the strokes) is small. (2) We greatly simplify the interactive process for color transfer with a new interactive scheme in which only changed regions require interactively marking strokes and the unchanged regions are calculated automatically. It is very convenient especially when the color values are plentiful in an image and most of them will be preserved after transferred. Our policy is that similar colors to those in the strokes follow the similar transformation

Read the paper · More papers on PaperTik