Development of a 3D User Interface based on Kinect Sensor and Bend-Sensing Data Glove for Controlling Software in the Mining Industry
Heonmoo Kim, Yosoon Choi · Journal of the Korean Society of Mineral and Energy Resources Engineers · 2019
In this study, we developed a 3D user interface (UI) using the Microsoft's Kinect sensor and bend-sensing data glove to control software in the mining industry. The developed UI controls the mouse cursor in Windows according to the user's hand position tracked by the Kinect sensor. In addition, it controls the mouse click events in Windows by measuring the user's finger flexion using the bend-sensing data glove. An open-source hardware, Arduino Lilypad Board, and National Instrument's LabVIEW software were used to develop the UI. Applications of the 3D UI to several 3D software utilized in the mining industry revealed that it can control the 3D software in more intuitive way than traditional UIs such as mouse and keyboard.