Leveraging Large Language Models for Enhanced VR Development: Insights and Challenges

Amany Alkhayat, Brett Ciranni, Rupa Samyukta Tumuluri, Rohit Srinivas Tulasi · 2024

This paper delves into the capabilities of Large Language Models (LLMs) in supporting beginner programmers in crafting virtual reality (VR) content for gaming and simulation applications. Our research group, comprising both seasoned and novice VR developers, engaged with versions of ChatGPT, including 3.5, 4, and Bard with Gemini Pro, during the development of various VR projects, spanning games to simulations. The findings, reflected through a comprehensive analysis of code quality and usability metrics, reveal that LLMs offer significant advantages for newcomers in the field. However, we also identify several challenges that must be addressed. This study enriches the discourse on obstacles faced in VR development and elucidates the impact of LLMs on coding and software creation, shedding light on both the advantages and hurdles of integrating LLMs into VR game production.

Read the paper · More papers on PaperTik