Get up and running with AI Virtual Mouse in minutes!
- Python: 3.11 or higher
- OS: Windows 10/11, macOS 10.14+, or Linux
- RAM: 4GB minimum
- Webcam: Standard USB or built-in camera
- Download and unzip the project
- Double-click
run.bat - Wait for dependencies to install (first time only)
- Allow webcam access when prompted
- Done! The app should start automatically
- Open Terminal in the project directory
- Run:
chmod +x run.sh && ./run.sh - Allow webcam access when prompted
- Done! The app should start
# 1. Create virtual environment
python -m venv venv
# 2. Activate it
# Windows:
venv\Scripts\activate
# macOS/Linux:
source venv/bin/activate
# 3. Install dependencies
pip install -r requirements.txt
# 4. Run the app
python main.py-
Launch the application
- Windows: Double-click
run.bat - macOS/Linux: Run
./run.sh
- Windows: Double-click
-
Grant Camera Permission
- Click "Allow" when prompted by your OS
-
Position yourself
- Sit 60-90cm in front of camera
- Ensure good lighting (no shadows on hand)
- Keep hand fully visible
-
Click "🎯 Calibrate Cursor"
- This sets baseline coordinates
-
Start using gestures!
Point your index finger
Other fingers closed
Index + Middle fingertips together
Like pressing a button
Close all fingers (fist)
Open all fingers wide
- Check camera is connected
- Try different USB port
- Allow camera permissions in Settings
- Restart application
- Improve lighting
- Move closer to camera
- Reduce background clutter
- Wear contrasting sleeve (light/dark hand)
- Increase smoothing slider
- Improve lighting
- Move more slowly
- Adjust cursor speed slider
All settings are in the right panel:
Cursor Speed: How far cursor moves
- Start: 1.0x (default)
- Too slow? Increase to 1.5x
- Too fast? Decrease to 0.5x
Smoothing: Reduce jitter
- Start: 0.7 (default)
- Too jumpy? Increase to 0.9
- Too laggy? Decrease to 0.5
Detection Confidence: Hand detection strictness
- Start: 0.7 (default)
- Missing detections? Lower to 0.5
- Too many false positives? Increase to 0.8
- Volume Up: Thumb + Pinky extended
- Volume Down: Thumb only
- Test: Open Settings → Sound to verify
- Scroll: Scroll up/down with fist/open-hand gesture
- Click links: Left-click gesture on link
- Go back: Right-click gesture for context menu
- Move to next slide: Use scroll down gesture
- Move to previous slide: Use scroll up gesture
- Click slides: Use left-click gesture
- Use as primary mouse on keyboard
- Combine with keyboard shortcuts (Alt+Tab, Win+D)
- Click UI elements without touching screen
- Better Detection: Clean camera lens
- Smoother Movement: Increase smoothing value
- Lower Lag: Reduce smoothing window (advanced settings)
- Better Accuracy: Improve lighting conditions
- Higher FPS: Close other applications
While application is running:
- ESC: Pause/resume tracking
- Q: Open settings (within app)
- H: Show help window
- C: Calibrate cursor
- Practice gestures: Get comfortable with basic gestures
- Adjust settings: Fine-tune for your setup
- Explore advanced settings: Click "⚙️ Settings" button
- Read full README.md: For detailed documentation
- Check DEVELOPER.md: If you want to extend functionality
✅ Do:
- Practice in good lighting
- Position camera at eye level
- Keep hand steady when clicking
- Move smoothly and deliberately
- Take breaks to prevent fatigue
❌ Don't:
- Use in low light
- Have cluttered background
- Wave hand erratically
- Move camera during use
- Cover camera lens
- Check README.md - Full documentation
- Run test_suite.py - Test components
python test_suite.py
- Check virtual_mouse.log - Error details
- See DEVELOPER.md - Technical details
Just delete the project folder. No system files are modified.
Configuration files stored at:
- Windows:
C:\Users\YourName\.virtual_mouse - macOS:
~/.virtual_mouse - Linux:
~/.virtual_mouse
You're now ready to control your computer with hand gestures!
Pro Tip: Once you're comfortable, try these advanced features:
- Use drag gestures for drawing
- Combine with keyboard for gaming
- Set up custom shortcuts in settings
- Practice with different hand positions
Happy gesturing! 👋