Development of Human Interface Software in our Dental Surgical System based on Mixed Reality
Hiroshi Noborio, Yusuke KAWAMOTO, Tomoaki TATSUMI, Miho ASANO, Daisuk SASAKI, Satoshi Yamaguchi, Yoshinori Yoshida, Taiji Sohmura · The Japanese Journal for Medical Virtual Reality · 2010
In this paper, we present human interface software of our dental surgical system. The system is based on mixed reality. With the help of this, a student virtually scrapes a concave tooth by a bar located at the tip of turbine. First of all, all dental data of teeth, dental bar, dental turbine, and dental mirror are captured from a dental CT-scanner as triangular polyhedrons with the STL formal. Secondly, by using GPU (Graphics Processing Unit), we convert many triangular polyhedrons (STL) of teeth and dental bars into octrees (a set of voxels) and sets of points, respectively. Then, we develop an efficient interference check algorithm between octree-based tooth and point-based bar. On the basis of the digital algorithm, we identify their intersection points quickly. Moreover, according to the intersection set, we scrape an octree-based tooth by a point-based bar, and simultaneously make an artificial force and moment quickly. Finally, a dental doctor flexibly selects visual and tactile parameters according to their many experiences. On the other hand, our dental surgical system evaluates a student operation against a professional one by comparing their scraping teeth shapes. For this reason, all the students learn many surgical operations in our system on demand via PC and internet.