A Remote Sharing Method of 3D Physical Objects Using Instance-Segmented Real-Time 3D Point Cloud for Design Meeting
Ryo Onishi, Tomohiro Fukuda, Nobuyoshi Yabuki · Proceedings of the International Conference on Computer-Aided Architectural Design Research in Asia · 2022
In the field of architecture and urban design, physical models are used in design meetings. Furthermore, teleconferencing via the internet has begun to be widely used in society due to COVID-19 and in preparation for disasters. Although conventional web conferencing can share only 2D information through screens, it is expected that interactive screen sharing of physical objects will enable smoother remote conferencing. A system that can manipulate point clouds in clusters by dividing real-time point clouds captured from 3D real objects by distance has been reported as a way to share physical objects. However, because the point clouds are divided by distance between the two clusters when the point clouds get closer than some threshold, they become treated as a single object. In this study, we aim to develop a system that uses instance segmentation to divide point clouds by region rather than by distance between objects. This system is expected to contribute to the realisation of better architectural and urban design processes without any misunderstandings among the parties involved and to the reduction of unnecessary energy consumption due to travel for face-to-face meetings.