Cloud-based Rendering System for Presentation of Immersive Media on Various Types of Devices
Shuichi Aoki, Yuji Ohkawa, Tetsuya Hayashida, Yoshiro Takiguchi · ACM International Conference on Interactive Media Experiences · 2024
Immersive media is an advanced form of applications such as Virtual Reality (VR), Augmented Reality (AR), and eXtended Reality (XR). It allows users to move freely in a video space that makes use of the real world and virtual world without distinction, and to view images from any location. It is a 6 degrees of freedom (DoF) media that provides users with experiences that feel as though they are in the video space. We are currently promoting research and development to realize immersive media that can be used on various types of presentation devices. If immersive media can be accessed from existing devices such as smartphones and PCs, as well as from devices that provide a particularly realistic feeling, such as head-mounted displays, users will be able to utilize immersive media on more occasions. Moreover, it is desirable for content creators that one immersive content be usable on various types of presentation devices, rather than each immersive content having to be newly created for a specific type of device. We consider immersive content to be content that does not assume specific device capabilities. In this work, we propose a system that renders the content on a cloud in order to produce images for presenting on devices having different capabilities. This paper reports our experimental finding confirming immersive content consisting of scene descriptions and volumetric video can be presented on three types of presentation devices using a renderer built on a virtual server on a cloud.