Using text N-grams for model suggestions in 3D scenes

Laureen Lam, Sharon Xiaowen Lin, Pat Hanrahan · 2012

Creating 3D scenes requires artistic skill and is time-consuming. A key challenge is finding novel models to place in a partial scene. We present a new algorithm to propose relevant models by leveraging text data. Our algorithm takes a partially completed 3D scene as input and a user-specified region of interest. It then suggests additional models according to the point-wise mutual information between the labels of nearby models in the scene and the labels of models in the database. We show that our text-based system suggests more models that result in model arrangements not observed in the training corpus, compared to a Graph Kernel system that trains on 3D scene data. Furthermore, combining the Graph Kernel system with our new system increases the number of unobserved model arrangements for the Graph Kernel, with higher precision according to human evaluators.

Read the paper · More papers on PaperTik