Eye-Tracking Control System for Intuitive Hands-Free Human-Computer Interaction and Mouse Navigation
Sandeep Kumar, Swathi Gowroju, Nadigadda Shravani, Krishna Prakash · Advances in computational intelligence and robotics book series · 2025
With today's sophisticated technologies, there is always room for advancement in the computing industry. As of right now, HCI is in demand since it helps people with quadriplegia. This study presents an effective Human-computer interaction (HCI) solution for amputees and individuals with hand impairments. The developed system translates eye motions, such as winking, into facial movements, such as expanding the lips and rotating the face (pitch and yaw) according to the cursor's path on the mouse. If the amputee can discern the angle at which the tip of their nose is pointing and detect eye movement, they can freely move the pointer by tracking the motion of their nose and eye to the mouse. A “tracking mouse” will be very helpful to an amputee. “The system under discussion uses a simple webcam and requires facial recognition using ML languages and a few more software packages. Building the face detector using a sliding window method, a linear classifier, and the Histogram of Oriented Gradients feature, there is no need for additional gear or sensors, and it is hands-free.