Framing Seamlessness-Enhancing Future Multimodal Interaction from Physical to Virtual Spaces
Nan Qie, Nick Bryan–Kinns, Fangli Song, Francisco Rebelo, Roger MacLaren Ball, Yijing Yang, Le Du, Wei Wang · 2023
Seamless human-computer interaction (HCI) was first proposed at the end of the last century. Since then, it has evolved, faced challenges, and recently experienced a revival across emerging HCI domains, driven by advancements in AI and 5G technologies. However, its concept has undergone significant changes. Within the context of user experience (UX) design, this term typically emphasizes the harmonious integration of various input, output modalities, and platforms to create a cohesive and consistent experience in interactive surface and spaces. In this workshop, we bring together academia and industry voices from around the globe, spanning mobile interaction, automotive human-machine interface (HMI), musical entertainment, mixed reality (MR) and wearables domains. We delve into the technology-driven transformation of seamless multimodal experience (SME), through addressing theoretical and methodological issues, exploring dimensions, guidelines, opportunities, as well as challenges for seamlessness innovation in HCI. Concurrently, we investigate approaches to harness these technologies to unlock the potential of multimodal user interfaces (MUIs) in seamless interactions. More broadly, we explore innovative SME concepts using a participatory design tool. Our collective goal is to achieve a shared understanding among participants and establish a framework of SME that will guide future human-computer interaction from physical to virtual spaces.