A Framework for Eye-Based Human Machine Interface
Shimul Bhowmick, Hossen Asiful Mustafa · 2021
To improve lifestyle, Human Machine Interface(HMI) plays a significant role. The human eye is one of the most prominent features of the face that shows useful information besides facial expressions, e.g., eye blink, eye motion and pupil motions. These can be used to create an eye-based platform to control different components that can be beneficial for motor disable people. Besides biological activities, eye blinking can also be used for interaction. Most of the existing human machine interface required motion of physical organ, which are not feasible to use by motor disable people. Using eye blink command to interact with machine can give a solution. In this work, we present an eye-based HMI framework using eye blinks and computer vision techniques that can interact between humans and machines. The framework allows defining rules to map blink patterns to perform different activities.We have designed a framework with simple hardware interfacing that can extract blink information and use this information to control computer applications and household appliances. Evaluation results show that the system is highly effective in detecting human eye blink in real-time and can be used to interact with applications and machines easily.