Next-gen interaction experience using virtual mouse system
Naga Sasha Lakshmi Pokanati, Satvik Reddy Alla, Sai Raja Pradeep Pampana, Ashan Mohammad, Swamy Sakala, Veera Venkata Naga Surya Devi Sai Chintam · International Journal of Science and Research Archive · 2025
The Virtual Mouse System is an innovative, touch-free control mechanism that replaces traditional computer mice using computer vision and artificial intelligence (AI). With a standard camera or webcam, it interprets hand, head, and eye gestures to perform actions like cursor movement, clicking, and scrolling. Designed for both general users and individuals with physical disabilities, it provides an intuitive, accessible, and futuristic interaction method. Key technologies like OpenCV and AI enable real- time gesture recognition, making it suitable for applications in accessibility, gaming, and education. This system eliminates physical devices, offering convenience and a modern dimension to human-computer interaction. This project focuses on developing a Virtual Mouse System using Python, MediaPipe, and PyAutoGUI, enabling users to control a computer cursor with simple hand gestures. The system leverages MediaPipe’s Hand Tracking API to detect hand landmarks and recognize specific gestures, which are then mapped to mouse actions such as cursor movement, clicking, dragging, and scrolling.