Bringing Instant Neural Graphics Primitives to Immersive Virtual Reality
Ke Li, Tim Rolff, Susanne T. Schmidt, Reinhard Bacher, Simone Frintrop, Wim P. Leemans, Frank Steinicke · 2023
Neural radiance field (NeRF), in particular, its extension by instant neural graphics primitives is a novel rendering method for view synthesis that uses real-world images to build photo-realistic immersive virtual scenes. Despite its enormous potential for virtual reality (VR) applications, there is currently little robust integration of NeRF into typical VR systems available for research and benchmarking in the VR community. In this poster paper, we present an extension to instant neural graphics primitives and bring stereoscopic, high-resolution, low-latency, 6-DoF NeRF rendering to the Unity game engine for immersive VR applications.11Link to the repository: https://github.com/uhhhci/immersive-ngp