A touch-free Human-Computer Interaction (HCI) system that combines facial recognition for secure authentication and gesture-based controls for managing system functions, designed to enhance accessibility and usability for all users.
With the rise in demand for contactless computing, this project introduces an innovative HCI system using:
- Facial Recognition (via Dlib) for secure, passwordless login
- Gesture Recognition (via OpenCV) for controlling brightness, volume, applications, and media playback
It is designed to aid both general users and differently-abled individuals, offering an intuitive and hands-free way to interact with computers.
-
🔒 Facial Recognition Login
Secure user authentication using real-time face detection -
👋 Custom Gesture Profiles
User-specific gestures for personalized control -
💻 System Control
Adjust brightness, volume, and control cursor movement with hand gestures -
📂 Application Control
Launch, close, and switch between applications with ease -
🎞️ Media & Screen Navigation
Gesture support for media control, scrolling, and zooming -
🔐 Auto Lock/Unlock
Locks screen when the user leaves and unlocks upon return -
🔔 Notification Management
Dismiss or view notifications using gestures
- OpenCV – Real-time computer vision for gesture recognition
- Dlib – Machine learning toolkit for facial recognition
- Python
- Face Recognition: Authenticates the user during login
- Gesture Detection: Detects and maps predefined gestures to system actions
- Execution: Executes mapped function (like changing volume, opening an app, etc.)
- Hands-free system interaction for differently-abled users
- Touchless computing in hygiene-sensitive environments
- Efficient multitasking without a mouse or keyboard
| System/Project | Features | Advantages of This System |
|---|---|---|
| Microsoft Kinect | Gesture control for gaming and apps | Desktop-oriented, with facial login and custom gestures |
| Leap Motion | VR/AR hand tracking | Adds facial recognition and full system gesture control |
| Apple Face ID | Facial recognition only | Integrated with gesture-based desktop interaction |
| Google Soli | Radar-based gestures (mobile-focused) | Broader application scope, PC-specific multi-user profiles |
| Intel RealSense | 3D sensing, facial detection | Prioritized accessibility, with personalized gesture workflows |
- OpenCV Documentation
- Dlib Documentation
- ResearchGate: Real-Time HCI Based on Face and Hand Gesture Recognition
- Nadiapub: Gesture Recognition in HCI – View Article
Contributions are welcome! Feel free to fork this repo and submit a pull request.
This project is licensed under the MIT License.
- AI-driven gesture learning
- Voice-gesture hybrid interaction
- Cross-platform support (Linux/macOS)