AI Virtual Mouse And Keyboard

Abstract

The AI Virtual Mouse and Keyboard project introduces a groundbreaking touchless interface that leverages real-time hand gesture recognition to control mouse and keyboard functions without the need for physical devices. Utilizing a standard webcam, the system captures hand movements and processes them using advanced computer vision techniques and artificial intelligence. Built with Python, OpenCV, and MediaPipe, it tracks 21 hand landmarks to interpret gestures with high accuracy. The virtual mouse component enables smooth cursor movement, clicks, scrolling, and drag-and-drop actions, while the virtual keyboard detects finger positions over an on-screen layout, allowing users to type by simply gesturing in the air. This system is designed with both convenience and hygiene in mind, offering a contactless alternative to traditional input devices. It is particularly useful in environments where physical touch is impractical or undesirable, such as hospitals, public kiosks, and cleanroom settings. Moreover, it significantly enhances accessibility for individuals with physical disabilities by reducing reliance on conventional hardware. With customizable features, the system allows users to adjust gesture sensitivity, feedback options, and keyboard behavior, ensuring a personalized and inclusive experience.