AI-Powered Virtual Mouse Control Through Hand Gestures With Computer Vision
Arjun Paramarthalingam, Ashokkumar Janarthanan, Amirthasaravanan Arivunambi, Srinivas saravanan Ariyangavu, Hariprasath Senthamaraikannan, Rekha Ganapathy · Advances in geospatial technologies book series · 2024
This article introduces an Artificial Intelligence (AI) enabled virtual mouse system that utilizes hand gestures and fingertip detection to operate computer mouse functions through AI and computer vision techniques. It serves as a convenient alternative to traditional physical mouse, offering users increased flexibility and accessibility in navigating and controlling their devices. In this article, the proposed work uses three modules such as OpenCV, MediaPipe and PyautoGUI to create the virtual mouse system. OpenCV library is used for its real-time computer vision functionality to help us to capture the hand using the web camera. The MediaPipe framework is used to detect the hand region using KLT Tracking Algorithm and then the K-cosine border tracking algorithm is used to identify various types of hand gesture movements to mimic the computer mouse cursor movement and scrolling operations. The PyAutoGUI module is used to perform appropriate mouse actions based on the recognized hand gestures.