AR in the OR: exploring use of augmented reality to support endoscopic surgery
Talha Ahmed Khan, Edward G. Andrews, Paul A. Gardner, Arka N. Mallela, Jeffrey R. Head, Joseph C. Maroon, Georgios Andrea Zenonos, Dmitriy Babichenko, Jacob T. Biehl · ACM International Conference on Interactive Media Experiences · 2022
Modern operating rooms (OR) are equipped with several ceiling- and wall-mounted screens that display surgical information. These physical displays are restricted in placement, limiting the surgeons’ ability to freely position them in the environment. Our work addresses this issue by exploring the feasibility of using an augmented reality (AR) headset (Microsoft HoloLens 2) as an alternative to traditional surgical screens; leading to a reduced OR footprint and improved surgical ergonomics. We developed several prototypes using state-of-the-art hardware/software and conducted various neurosurgery-related exploratory studies. Initial feedback from users suggests that coloration and resolution of the holographic feed were adequate, however, surgeons frequently commented on tactile/visual asynchrony. This emphasizes the need for novel, more efficient hardware/software solutions to support fine motor tasks in the OR.