An eXtended Reality Data Transformation Framework for Internet of Things Devices Integration
Wendy Yunuen Arevalo Espinal, J. P. Rojas Jiménez, Lorenzo Corneo · 2024
The multidisciplinary nature of XR applications makes device and data integration a resource-intensive and time-consuming task, especially in the context of the Internet of Things (IoT).This paper presents Visualize Interactive Objects, VIO for short, a data transformation framework aimed at simplifying visualization and interaction of IoT devices and their data into XR applications.VIO comprises a software runtime (VRT) running on XR headsets, and a JSON-based syntax for defining VIO Descriptions (VDs).The VRT interprets VDs to facilitate visualization and interaction within the application.By raising the level of abstraction, VIO enhances interoperability among XR experiences and enables developers to integrate IoT data with minimal coding effort.A comprehensive evaluation demonstrated that VIO is lightweight, incurring in negligible overhead compared to native implementations.Ten Large Language Models (LLM) were used to generate VDs and native source-code from user intents.The results showed that LLMs have superior syntactical and semantical accuracy in generating VDs compared to native XR application development code, thus indicating that the task of creating VDs can be effectively automated using LLMs.Additionally, a user study with 12 participants found that VIO is developer-friendly and easily extensible.