RTC-MR: A WebRTC-based framework for real-time communication in Mixed Reality

Francisco M. García, Santiago Schez-Sobrino, C. Glez-Morcillo, Jose Jesus Castro-Schez, Javier A. Albusac, David Vallejo · Software Impacts · 2024

This paper presents RTC-MR, a real-time communications framework designed for integrating WebRTC into Mixed Reality (MR) environments, particularly optimised for Microsoft HoloLens 2™. By reducing the complexity associated with WebRTC implementation, our proposal aims to simplify the creation of custom applications that demand real-time audiovisual interaction. Beyond facilitating the development of MR applications, RTC-MR provides a valuable resource for both developers and researchers interested in exploring the full potential of MR in remote support scenarios and various other applications. • RTC-MR enables real-time communication in mixed reality environments. • RTC-MR’s architecture supports scalability and flexibility for MR applications. • RTC-MR optimises WebRTC integration for HoloLens 2 in MR applications. • RTC-MR enhances remote assistance in sectors such as healthcare and industry. • A use case shows RTC-MR’s potential in medical emergency scenarios.

Read the paper · More papers on PaperTik