Enhancing Hands-Free Human-Computer Interaction through Eye Tracking and Speech-Based Control
S. Karthik, B.R. Mohan, A. R. Devi, P. Vigneshwaran, R. Vignesh, T. Rengaraj · 2025
This research introduces an innovative hands-free human-computer interaction system that enhances user engagement through advanced computer vision techniques, primarily focusing on Dlib’s facial detection and landmark prediction algorithms. The core functionality of the system is centered on precise eye movement tracking for cursor control, enabling actions such as left and right clicks. Additionally, speech recognition has been seamlessly integrated to provide comprehensive system control, eliminating the need for physical interaction with conventional input devices. The intentional exclusion of facial gestures, including mouth tracking, contributes to a streamlined and accessible user experience, enhancing both usability and ease of interaction. The synergistic integration of eye movement tracking and speech recognition technologies represents a cutting-edge advancement in hands-free computing, demonstrating significant potential for intuitive control across diverse computational environments. This study not only establishes the feasibility of these integrated technologies but also lays the groundwork for future developments in the realm of hands-free human-computer interaction.