PhotoSketch: Internet Image Montage

Tao Chen, Ming‐Ming Cheng, Ping Tan, Ariel Shamir, Shi‐Min Hu · 2009

Figure 1: A simple freehand sketch is automatically converted into a photo-realistic picture by seamlessly composing multiple images discovered online. The input sketch plus overlaid text labels is shown in (a). A composed picture is shown in (b); (c) shows two further compositions. Discovered online images used during composition are shown in (d). We present a system that composes a realistic picture from a simple freehand sketch annotated with text labels. The composed picture is generated by seamlessly stitching several photographs in agree-ment with the sketch and text labels; these are found by searching the Internet. Although online image search generates many inap-propriate results, our system is able to automatically select suitable photographs to generate a high quality composition, using a filter-ing scheme to exclude undesirable images. We also provide a novel image blending algorithm to allow seamless image composition. Each blending result is given a numeric score, allowing us to find an optimal combination of discovered images. Experimental results show the method is very successful; we also evaluate our system us-ing the results from two user studies. 1

Read the paper · More papers on PaperTik