GAZD SPEEDUP: Eye Gaze Assisted Gesture Typing

Abstract

This paper presents GAZD SPEEDUP, a hands-free typing system that enables users to control computers entirely through eye gaze, blinks, winks, and voice commands. The system addresses the critical need for accessible computing solutions for individuals with motor disabilities or situations where hands-free operation is essential. GAZD SPEEDUP integrates real-time eye tracking using MediaPipe Face Mesh, a dwell-click mechanism with 1-second activation, multi-modal blink detection (single blink, double blink, left wink, right wink), voice command recognition, and a fully functional virtual keyboard with light/dark themes. The system operates without stealing focus from other applications, allowing seamless integration with existing workflows. Experimental results demonstrate a typing speed of 8- 12 words per minute with 92% accuracy after 30 minutes of practice, 94.4% blink detection accuracy under normal lighting conditions, and 4.3/5 user satisfaction across 20 test participants. GAZD SPEEDUP represents a significant advancement in accessible computing, offering a cost-effective solution that requires only a standard webcam.