A Tangible Augmented Reality Programming Learning Environment for Textual Languages
Dmitry Resnyansky, Mark Billinghurst, Gun Lee · 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) · 2022
We present a novel Tangible Augmented Reality Programming Learning Environment system that uses a head-mounted display (HMD) and physical manipulatives for teaching an Object-Oriented Programming (OOP) language. The system supports student understanding/recollection of terms, and construction of statements by enabling access to code components, terminology, and programming hints. It is designed to use the affordances of Augmented Reality (AR) and Tangible User Interfaces (TUIs) to provide a virtual workspace encouraging natural interaction with learning material. An interactive AR code template for physical manipulatives provides a building and testing environment for learners to practice statement construction and computational skills. The system bolsters active learning with a localised AR program visualisation and HMD-anchored AR glossary.