INTELLIGENT VOICE AND GESTURE CONTROLLED ROBOTIC VEHICLE USING ESP32

Abstract

The rapid advancement of Artificial Intelligence (AI), embedded systems, and wireless communication technologies has significantly accelerated the development of intelligent robotic systems capable of autonomous and human-interactive operation. Conventional robotic vehicles generally rely on manual remote controllers or predefined navigation mechanisms, which limit operational flexibility and user convenience. These limitations make conventional robots less suitable for applications involving physically challenged individuals, industrial automation, hazardous environments, healthcare, surveillance, and smart assistance systems. Recent developments in Artificial Intelligence (AI), computer vision, gesture recognition, speech recognition, Internet of Things (IoT), and ESP32-based embedded platforms have enabled the development of intelligent robotic vehicles capable of responding to both voice commands and hand gestures in real time. This project presents an AI-Based Voice and Gesture Control Robotic Vehicle Using ESP32. The proposed framework integrates an ESP32 controller, AI voice recognition module, gesture sensor/accelerometer, motor driver, DC motors, Bluetooth/Wi-Fi communication, ultrasonic obstacle detection sensor, and mobile application into a unified intelligent robotic system. The ESP32 continuously receives voice commands and gesture inputs, processes them using AI-based recognition algorithms, and generates corresponding motor control signals for vehicle navigation. The robotic vehicle performs forward, backward, left, right, and stop movements while continuously monitoring obstacles to prevent collisions. Whenever an obstacle is detected, the robot automatically stops and generates warning alerts to ensure safe operation. Experimental evaluation demonstrates high voice recognition accuracy, reliable gesture recognition, stable wireless communication, low response time, accurate obstacle detection, and efficient robotic navigation under different operating conditions. The proposed framework significantly improves human–robot interaction, enhances operational flexibility, reduces manual effort, and provides a costeffective solution for intelligent robotic control systems applicable to healthcare, industrial automation, surveillance, and smart assistive technologies. Keywords: Artificial Intelligence (AI), ESP32, Voice Recognition, Gesture Recognition, Robotic Vehicle, Motor Driver, Ultrasonic Sensor, Embedded Systems, IoT, Wireless Communication, Human–Robot Interaction.