SketchBoard: Sketch-Guided Storyboard Generation for Game Characters in the Game Industry
Elicia Min Yi Chan, Chee Kiat Seow, Esther Tan, Min Wang, Peter ChunYu Yau, Qi Ping Cao · 2024
Research outcomes have been reported to various industrial applications of Artificial Intelligence generated content (AIGC). This paper explores AI assisted creative production of storyboard and game characters in the game industry, by leveraging Stable Diffusion 1.5 coupled with Control Nets (SD-1.5+CN) for image generations and Generative Pretrained Transformer (GPT) of OpenAI for narrative generations. Experiment evaluations are conducted for visual appeal and narrative flows of the generated contents using SketchBoard. The results illustrate SketchBoard with weighted prompts achieving a higher Contrastive Language-Image Pre-Training (CLIP) score than the baseline models. In addition to reducing the time and effort required for manual creation, it obtains strong alignments between the generated images and provided text prompts. User study is conducted where the user feedback indicates a high level of satisfaction, with 92 % of participants expressing enj oyment and contentment with SketchBoard. Its ability to generate visually appealing storyboard frames with coherent narratives offers opportunities for efficient storyboard creation, paving the way for future advancements in automated storyboard generation.