Gesture Controlled Robotic Car with Robotic Arm using ESP32

Abstract

In this study, the robotic vehicle is made using ESP32 microcontrollers and connected with the robotic arm, and is controlled by gestures to achieve intuitive and wireless human-machine interaction. The technology is based on a real-time gesture control system that uses hand gestures to manipulate and control the movement of the vehicle and the manipulator itself. The flex sensors on the wearable glove are responsible for sensing the bending motion of the fingers, while the inertial sensor MPU6050 is used to detect the dynamics of the hand's movements and the orientation of the hand. The gathered sensor data are processed by an ESP32 (transmitter node), and the gesture inputs are converted to the control command. These directives are sent using ESP-NOW protocol which provides low latency and dependable wireless connection between devices. A second ESP32 is mounted on the robot platform, which receives instructions, decodes them and commands the DC motors to drive the robot in various directions and the servos motors to move the robot arm. The coordinated coordination between the movement and manipulation functions are ensured by this integrated architecture. The system is ideal for applications in industrial automation, hazardous environment management, assistive robots and smart surveillance jobs. Experimental results show that embedded gesture-based control for robotic systems can provide responsive control, consistent communication and increased operational efficiency with little latency. In the future, improved sensor fusion, extended range communication, enhanced autonomy and real time adaptive control for efficient and complicated robotic operations in dynamic situations will be addressed.