Multimodal Interaction Design for Public Window Displays: A Case Study
Xiao-Nan Liu, Min-Zhi Shao · 2020
We present a case study of multimodal interaction design for public window displays. Using a classic fairytale as the theme story, a prototype system that integrates mobile, gesture, tangible, touchscreen, and puppet interfaces has been implemented. The preliminary field deployment results demonstrate that our interactive window is well-received, with a significantly extended duration of user's interaction time. We conclude with a discussion of lessons learned and potential new research problems for interactive public window design. We believe our findings are useful in future design for interactive shop windows, theater showcases, and exhibition displays.