Skip to content

Repository files navigation

VirtualTouch AI

VirtualTouch AI is a native macOS utility that uses a webcam, Apple Vision landmarks, local prediction, and Core Graphics to control the cursor with finger and arm movement.

Download

Current beta: Build 15 (BETA 1.6.1) — macOS 11 compatible

Previous releases: Build 14 · Build 13

Open the DMG and drag VirtualTouch AI.app into Applications. On first launch, grant Camera and Accessibility access.

Requirements

  • macOS 11.0 or later
  • Intel or Apple Silicon Mac
  • Built-in or external webcam
  • Camera permission
  • Accessibility permission for cursor movement and clicks

Build 15 targets macOS 11 and later using Apple hand pose APIs available on macOS 11.

Features

  • Direct index-finger cursor tracking
  • 35 FPS Vision hand-processing target
  • Wrist, arm, and trajectory click estimation
  • Flick, pinch-to-drag, swipe, dwell, and voice click/left commands
  • Voice Stop command
  • Full-screen nine-target calibration
  • Bottom-right draggable/resizable session overlay
  • End Session control
  • Tutorial and diagnostics pages
  • Local calibration storage; no network or telemetry

Setup Guides

Build from Source

ruby generate_project.rb
DEVELOPER_DIR='/Volumes/Other Storage/Xcode.app/Contents/Developer' xcodebuild \
  -project VirtualTouchAI.xcodeproj \
  -scheme VirtualTouchAI \
  -configuration Release \
  build CODE_SIGNING_ALLOWED=NO

Package the app:

./create_dmg.sh

Privacy

Camera frames, pose landmarks, calibration samples, and voice processing remain on the user's computer. The app does not upload personal data or use cloud AI services.