Enhancing Virtual Experiences: A Holistic Approach to Immersive Special Effects
Georgios Tsaramirsis, Oussama H. Hamid, Amany Tharwat Mohammed, Zamhar Ismail, Princy Randhawa · 2023
To create a more immersive experience, electronic content developers utilize hardware solutions that not only display images and produce sounds but also manipulate the viewer’s real environment. These devices can control visual effects like lighting variations and fog, emit scents, simulate liquid effects, and provide vibration or locomotion sensations, such as moving the viewer’s chair. The goal is to emulate additional sensations for the viewers and engender the belief that they are truly present within the virtual environment. These devices are typically found in specially designed cinemas referred to as xD cinemas, such as 4D, 5D, 9D, etc., where each effect is treated as an additional dimension, enhancing the overall experience. Currently, all of these effects are triggered by timers. The system determines which effect to play based on timers. This approach is problematic, for it requires programming each device for each movie. In this research, we address this problem by introducing the idea of Special Effect Tags (SETs) that can be added in the subtitle files. The SETs aim to serve as a standard that will allow the various devices to know when each artificial phenomenon should be triggered. They are generic and can support infinite artificial phenomena, also known as dimensions. This paper introduces the idea of a common special effect framework and a generic architecture of a special effects player that is independent of any specific hardware solutions.