Air Command : A Vision Driven Gesture and Gaze Control System

Abstract: Human computer interaction is commonly performed using physical input devices, which may not be suitable in all environments or for all users. This paper presents Air Command, a vision-driven gesture and gaze control system that enables hands-free computer interaction using a standard webcam. The system combines gaze-based cursor movement with hand gesture-based command execution, allowing users to perform operations such as clicking, scrolling, zooming, and application control without physical contact. Eye blink detection is used for mouse click actions, while predefined hand gestures trigger system commands. The proposed approach operates in real time on consumer-grade hardware and incorporates stability mechanisms to reduce unintended actions. Experimental results demonstrate reliable performance under normal conditions, highlighting the feasibility of vision-based interaction as an effective alternative to traditional input devices.

Keywords: Human–Computer Interaction, Computer Vision, Gaze Tracking, Hand Gesture Recognition, Touch-Free Interaction, Assistive Computing.