AI MOUSE GESTURE

Abstract

The AI Mouse Gesture Controller is an innovative application of Artificial Intelligence and Computer Vision that enables users to control computer operations through hand gestures instead of using a traditional physical mouse. The project focuses on creating a touchless and intuitive human-computer interaction system by utilizing real-time gesture recognition techniques. With the increasing advancement of AI technologies, gesture-based systems are becoming more efficient, interactive, and user-friendly for modern computing environments. The proposed system uses a webcam to capture live video input and applies computer vision algorithms to detect, track, and interpret hand movements. Specific gestures are mapped to various mouse functions such as cursor movement, left-click, right-click, double-click, scrolling, and drag-and-drop operations. The implementation is carried out using Python programming language with powerful libraries such as OpenCV for image processing, MediaPipe for hand landmark detection, and PyAutoGUI for controlling mouse operations on the computer screen. The system provides a contactless interface, making it suitable for environments where minimizing physical interaction is important, such as hospitals, smart classrooms, public kiosks, and presentation systems. It also improves accessibility for users with physical disabilities who may face difficulties using conventional input devices. The real-time performance and gesture recognition accuracy demonstrate the effectiveness of integrating AI and computer vision into everyday computing applications.