Digital Human Interaction Based on Mono Camera for Digital Twin

Myeongseop Kim, Taehyeon Kim, Kyung-Taek Lee · 2023

In virtual reality, the importance lies not only in digitally replicating real spaces, assets, forms, and actions but also in digitalizing the movements of individuals within these spaces from the perspective of digital twin technology. However, traditional methods, which require the use of Head Mounted Displays (HMD), VR devices, and various sensors attached to humans, impose significant constraints when reflecting the diverse actions of users within the actual digital twin. To overcome this, we introduce the "Digital Human Interaction based on Mono Camera" method. This approach simulates full-body human actions using an easily accessible mono camera. Through this method, we’ve identified the potential to broaden the range of user movements that can be mirrored in virtual reality while significantly reducing costs. Crucially, our approach is future-oriented and universally applicable because it does not require specialized equipment or sensors.

Read the paper · More papers on PaperTik