3DCrewCap: Applying 3D Volumetric video capture for XR helicopter rescue crew training and simulation.
John B. McGhee, Conan Bourke, Robert Lawther, Hao Zhou, Rolf Petersen · 2024
Helicopter rescue crew training scenarios are complex and hard to simulate in game engines with animated 3D digital characters. This challenge is compounded when simulating Realtime photorealistic animated character sequences on XR-based Head-Mounted Displays (HMD). In this research, we present a practical early-stage development of 3D volumetric video capture and playback workflow for use in helicopter rescue crew training on XR HMDs. We break down the workflow of using Gaussian Splat approaches to construct keyframed 3D animated models of the rescue crew training actions. This novel application approach provides a practical example of the photorealistic capture and XR display of helicopter rescue crew performing training scenarios.