Computer Control with Hand Gestures using Machine Learning (ML) and Computer Vision

Kaustubh Naithani, Dhruva Malik, Prashant Kumar, Mohammed Bilal, Monika Singh · 2023

In Human-Computer Interaction (HCI), the traditional mouse is a remarkable invention in computer technology which encounters limitations in modern Bluetooth and wireless models due to battery dependence and PC connectivity via dongles. These challenges are tackled by the proposed AI-driven hand gesture-based virtual mouse. By capturing hand movements via a webcam, this innovation employs gestures as a potent communication mode. It allows the computer to replicate functions like left and right-click, scrolling, and cursor control without a physical mouse, aiding in COVID-19 prevention and reducing bias in computer control. This system is integrated with voice commands and utilizing Machine learning (ML) and Computer Vision algorithms. It eliminates extra hardware requirements, enhancing accessibility and user interaction in diverse environments. Integrating new HCI technologies might be difficult because of software support requirements and compatibility problems. However, by providing more natural and intuitive interactions, lowering the learning curve, and enabling cutting-edge capabilities like gesture controls and multi-device connectivity, the productivity and user experience can be improved while eventually speeding up and streamlining activities.

Read the paper · More papers on PaperTik