Eye‐Based Cursor Control and Eye Coding Using Hog Algorithm and Neural Network
S. Sivaramakrishnan, G. Vasuprada, Vangala Ramanuja Harika, P. Vishnupriya, Supriya Castelino · 2023
For the physically challenged people cursor control using the eye movement plays a major role in helping them to perform the necessary task. Non-intrusive gaze estimation technique can help in the communication between humans and computers. The eye-gaze will be handy for the communication between physical challenged person and the computer. The pupil movement patterns also called as Eye Accessing Cues (EAC) is related to human brain's cognitive processes. This method in particular will be beneficial to the physical challenged people with disabilities such as Amyotrophic Lateral Sclerosis (ALS). In this chapter, a technique is proposed to control the mouse cursor in real time using the pupil movements. With the application of the image processing and graphic user interfacing technique (GUI) the cursor control can be rolled into reality using blink detection and gaze estimation. Hog algorithm helps in identifying the eye blink and pupil movements. Based on the detection the cursor control is carried out either directly tracking the pupil movement or tracking the same with the help of camera connected to the system. In this chapter the gaze direction is performed using Hog algorithm and machine learning algorithm. Finally, the cursor control is implemented by GUI automation. The same technique can be expanded to help the physically challenged person to write content and also to do python coding.