A new human computer interface of digital surgery based on holographic dual-channel synchronous AR lens
Tao Yu, Xiaofei Wang · 2023
The combination of IT technology and surgical technology has led to the development of digital operating rooms. The integration of digital technology and Artificial Intelligence (AI) in the operating room provides more accurate auxiliary information. The introduction of digital operating rooms has improved the quality of surgeries and transformed surgical operations. Recent progress has made Intraoperative Navigation (IN) possible. Surgeons are accustomed to using binocular microscopes during surgeries, with all procedures focused on the microscopic field of view. We have developed a new set of Augmented Reality (AR) lenses using the holographic dual-channel synchronous method. The AR lenses are integrated into the eyepiece of the operating microscope. The AI image analysis information and IN information are superimposed on the real-world surgical field of view to guide the surgeon using a new Human-Computer Interface (HCI) method. The new HCI method connecting AI with AR technology would greatly improve the skills and confidence of surgeons.