Skip to content

flowsxr/sidelineiq

Repository files navigation

SidelineIQ

Real-time AI coaching for football coaches — live tactical analysis delivered straight to your Ray-Ban Meta glasses.

Point your glasses at the pitch. Every 2 seconds, Claude Vision reads the game and sends a one-sentence coaching tip right to your lens. Eyes on your players, AI in your ear.

🎥 Watch the demo on Loom
🌐 Try it live
🏆 Cursor Boston x Hult Sports Hack 2026


How it works

  1. Open SidelineIQ on your phone or browser
  2. Hit Live — camera activates and starts streaming
  3. Point at training or match footage
  4. Every 2 seconds a frame goes to Claude Vision for analysis
  5. One-sentence tactical insight overlays on the video (web) or appears in the Ray-Ban Meta display (glasses)
  6. MediaPipe skeleton tracking shows player positioning in real time

Features

  • Live camera mode — real-time frame analysis every 2 seconds
  • Photo mode — snap or upload a frame for instant analysis
  • MediaPipe skeleton overlay — pose detection on all players
  • Ray-Ban Meta glasses support — analysis text pushed to the display lens via Meta DAT SDK
  • Mobile-first — works in browser on any device over HTTPS

Tech stack

  • Next.js (App Router) — web frontend + API route
  • Claude Vision API (claude-opus-4-5) — tactical analysis
  • MediaPipe Tasks Vision — real-time pose/skeleton detection
  • Meta Wearables DAT SDK (iOS) — Ray-Ban Meta Display integration
  • Tailwind CSS v4 — styling
  • Vercel — deployment

Setup

npm install
npm run dev

Add your Anthropic API key to .env.local:

ANTHROPIC_API_KEY=your_key_here

Open on your phone at http://YOUR_LOCAL_IP:3000 (HTTPS required for camera — use Vercel or ngrok for mobile testing).

Deploy

npx vercel --prod

Set ANTHROPIC_API_KEY in Vercel environment variables.


Hackathon

Built at Cursor Boston x Hult Sports Hack 2026 — Track 02: Athletes and Team Performance.

About

Real-time AI football coaching for coaches - live tactical analysis on Ray-Ban Meta glasses via Claude Vision + MediaPipe skeleton tracking

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

No releases published

Packages

 
 
 

Contributors