GitHub - sanjayrohith/ResQ-Desk: 🎙️ ResQ-Connect: transforming 911 calls into instant tactical actions using Generative AI. Listen. Analyze. Dispatch.

🎯 Real-time Emergency Response Management System

AI-powered dispatch platform that transforms emergency calls into actionable intelligence

🔗 Explore The Ecosystem

React • TypeScript • Vite
_{✨ Tactical Dashboard & Live UI} FastAPI • AI/NLP • Python
_{🔥 AI Engine & Command Center}

👨‍💻 The Architects

Sanjay Rohith
_{🚀 Lead Developer}

Sanjay E
_{🧠 AI & Backend}

Abishek Raj
_{🎨 Frontend Architect}

💡 The Problem We're Solving

⏱️ Every Second Matters

Emergency dispatchers are the unsung heroes operating under extreme pressure:

Challenge	Impact
📝 Manual Data Entry	Precious seconds wasted during high-stress calls
❌ Human Error	Incorrect resource deployment risks lives
🧠 Cognitive Overload	Managing multiple streams simultaneously
🐌 Delayed Response	Inefficient incident classification

    ┌──────────────────┐
    │   BEFORE ResQ    │
    │                  │
    │   📞 ──→ 📝     │
    │   Call   Manual  │
    │          Entry   │
    │                  │
    │   ⏰ +45 seconds │
    └──────────────────┘

    ┌──────────────────┐
    │   WITH ResQ-Desk │
    │                  │
    │   📞 ──→ 🤖     │
    │   Call   AI Auto │
    │          Fill    │
    │                  │
    │   ⚡ <3 seconds  │
    └──────────────────┘

✨ Features That Save Lives

🎙️ Live Call Management	🧠 AI Intelligence	📋 Auto Reports	🗺️ Tactical Maps
Push-to-talk interface	Real-time NLP analysis	Zero-touch form filling	Live unit tracking
Audio visualization	Smart data extraction	Severity classification	Auto-reallocation
Language detection	Keyword detection	AI reasoning display	Multi-unit coordination
Encrypted channels	Confidence scoring	Tactical alerts	ETA calculations

🎙️ Live Call Management

┌─────────────────────────────────────────────────────────────┐
│  🔴 LIVE CALL                                    00:01:23   │
├─────────────────────────────────────────────────────────────┤
│                                                             │
│  ████████████████░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░  │
│  ▁▂▃▅▂▁▂▃▅▇▅▃▂▁▂▃▅▆▅▃▂▁▂▃▄▅▆▇▆▅▄▃▂▁▂▃▄▅▆▇▆▅▄▃▂▁          │
│                                                             │
│  [🎤 PTT ACTIVE]    [🔇 MUTE]    [📍 LOCATE]    [🚨 ALERT]  │
└─────────────────────────────────────────────────────────────┘

🧠 AI-Powered Intelligence

"There's a fire on the second floor..."

⬇️ Instant AI Analysis ⬇️

Field	Extracted Value	Confidence
📍 Location	123 Main Street, 2nd Floor	`94%`
🔥 Type	FIRE	`98%`
⚠️ Severity	CRITICAL	`91%`
🏷️ Keywords	`FIRE` `SMOKE` `TRAPPED`	—

🗺️ Live Unit Tracking & Auto-Reallocation

Real-time fleet awareness with priority-based reallocation

┌─────────────────────────────────────────────────────────────┐
│  🗺️  LIVE FLEET                              4/6 AVAILABLE   │
├─────────────────────────────────────────────────────────────┤
│  🚑 A12   Ambulance     🟢 AVAILABLE           ETA   6m     │
│  🚒 FE12  Fire Engine   🟠 ON SCENE  (Normal)  ETA   4m     │
│  🚒 FE13  Fire Engine   🟠 ON SCENE  (Normal)  ETA  15m     │
│  🚤 B6    Rescue Boat   🟢 AVAILABLE           ETA  31m     │
├─────────────────────────────────────────────────────────────┤
│  ⚠️  CRITICAL FIRE — no free Fire Engine                     │
│  🔁 REALLOCATE  FE12   (Normal ➜ Critical)      [ CONFIRM ]  │
└─────────────────────────────────────────────────────────────┘

Every unit carries a live lifecycle status that updates on the tactical map in real time:

Status	Meaning	Marker
🟢 AVAILABLE	Idle, ready to dispatch	Green
⚪ EN ROUTE	Assigned, travelling to the incident	Platinum (pulsing)
🟠 ON SCENE	Arrived, working the incident	Amber
◻️ RETURNING	Job done, heading back to base	Slate

    AVAILABLE  ➜  EN ROUTE  ➜  ON SCENE  ➜  RETURNING  ➜  AVAILABLE

When a Critical incident arrives and every capable unit is busy, the orchestrator doesn't just report "none available" — it finds a unit on a lower-priority job and proposes pulling it off. The dispatcher gets a one-click confirmation, and the reassigned unit immediately begins moving toward the new scene on the map.

🛰️ Intelligent Map — Wired to Real Data

Every pixel means something — the map isn't decoration, it's the spatial source of truth

📍 Real geocoding — the AI-extracted location is resolved to actual coordinates, so the incident marker lands on the real address (e.g. Phoenix Marketcity, Chennai), not a placeholder.
📏 Distance-aware placement — units are positioned around the incident by their real distance_km; the closer a unit is, the closer it renders.
🛣️ Live routes — dispatched units draw an animated route line and travel along it toward the scene in real time.
🎯 Auto-framing & click-to-locate — the camera auto-fits the incident and its responders; click any unit to fly straight to it.
🧭 Dispatch overlay — a live summary (FE12 inbound · 4 min · 2.3 km) plus a status legend keep the tactical picture readable at a glance.

🏗️ System Architecture

                    ╔═══════════════════════════════════════╗
                    ║         ResQ-Desk Architecture        ║
                    ╚═══════════════════════════════════════╝

    ┌─────────────────┐         ┌─────────────────┐         ┌─────────────────┐
    │                 │         │                 │         │                 │
    │   🎤 Web Speech │────────▶│  ⚛️ React UI   │────────▶│  🧠 AI Backend  │
    │       API       │         │   (This Repo)   │         │   (FastAPI)     │
    │                 │         │                 │         │                 │
    └─────────────────┘         └─────────────────┘         └─────────────────┘
           │                           │                           │
           │                           │                           │
           ▼                           ▼                           ▼
    ┌─────────────────┐         ┌─────────────────┐         ┌─────────────────┐
    │  Voice → Text   │         │  Tactical UI    │         │  NLP Analysis   │
    │  Recognition    │         │  Live Dashboard │         │  Data Extract   │
    └─────────────────┘         └─────────────────┘         └─────────────────┘

🛠️ Tech Stack

Layer	Technology	Badge
UI Framework	React 18
Language	TypeScript
Build Tool	Vite
Styling	Tailwind CSS
Components	shadcn/ui
State	TanStack Query

🎨 Design Language

A premium, blacked-out command-center aesthetic — built to feel calm under pressure.

Element	Treatment
🖤 Palette	Deep matte black with a refined platinum accent; colour is reserved for meaning
🚦 Semantic colour	Red = Critical · Amber = High · Emerald = Available — the only saturated tones on screen
✨ Micro-interactions	Count-up confidence & ETA, an odometer-style rolling clock, staggered panel entrances
🌌 Ambience	Slow-drifting aurora glow, a living tactical grid, and glassmorphic panels
🔁 Reallocation flow	An animated transfer view showing a unit move from its old job to the new critical scene

🚀 Quick Start

📋 Prerequisites

✅ Node.js 18+ or Bun
✅ Modern browser (Chrome 80+, Firefox 76+, Safari 14+)
✅ Microphone access for speech recognition

⚡ Installation

# 1️⃣ Clone the repository
git clone https://github.com/sanjayrohith/ResQ-Desk.git

# 2️⃣ Navigate to project
cd ResQ-Desk

# 3️⃣ Install dependencies
npm install

# 4️⃣ Launch development server
npm run dev

🎉 Open http://localhost:5173 and start saving lives!

📁 Project Structure

ResQ-Desk/
│
├── 📂 src/
│   ├── 📂 components/
│   │   ├── 📂 dashboard/
│   │   │   ├── 🎯 Header.tsx           # System status & nav
│   │   │   ├── 📞 LiveCall.tsx         # PTT controls & timer
│   │   │   ├── 📝 LiveTranscription.tsx # Speech-to-text engine
│   │   │   ├── 📋 IncidentDetails.tsx  # AI form automation
│   │   │   ├── 🗺️ MapPanel.tsx         # Tactical deployment
│   │   │   └── 🚨 DispatchPopup.tsx    # Unit assignment
│   │   │
│   │   └── 📂 ui/                      # shadcn/ui components
│   │
│   ├── 📂 pages/
│   │   └── 🏠 Index.tsx                # Main orchestration
│   │
│   ├── 📂 hooks/                       # Custom React hooks
│   └── 📂 lib/                         # Utilities
│
└── ⚙️ Configuration files

🔄 How It Works

graph LR
    A[📞 Emergency Call] -->|Voice Input| B[🎤 Live Transcription]
    B -->|Text Stream| C[🧠 AI Analysis]
    C -->|Structured Data| D[📋 Auto-fill Form]
    D -->|Dispatch Ready| E[🗺️ Resource Dispatch]
    E -->|Unit Assigned| F[🚑 Deployment]
    
    style A fill:#FF6B6B,color:#fff
    style B fill:#4ECDC4,color:#fff
    style C fill:#45B7D1,color:#fff
    style D fill:#96CEB4,color:#fff
    style E fill:#FFEAA7,color:#333
    style F fill:#00D26A,color:#fff

Step	Action	Time
1️⃣	Call Initiated — Operator activates PTT, caller speaks	`0s`
2️⃣	Real-time Transcription — Speech converted instantly	`<1.5s`
3️⃣	AI Processing — Backend extracts location, type, severity	`~2-3s`
4️⃣	Form Auto-fill — Incident details populate automatically	`instant`
5️⃣	Dispatch Decision — System suggests optimal unit	`ready`
6️⃣	Unit Deployment — Responders receive coordinates & ETA	`🚀`

🔌 API Integration

📡 Backend Communication

Endpoint

POST http://127.0.0.1:8000/analyze

Request

{
  "text": "There's a fire on the second floor of 123 Main Street"
}

Response

{
  "incident_id": "INC-2024-001",
  "location": "123 Main Street, 2nd Floor",
  "emergency_type": "FIRE",
  "severity": "Critical",
  "keywords": ["FIRE", "SMOKE", "TRAPPED"],
  "reasoning": "Multiple fire indicators detected with potential victims",
  "confidence_score": 0.94,
  "suggested_unit": "F07",
  "reallocation": null
}

🚒 Live Unit Tracking & Reallocation

Endpoints

GET  http://127.0.0.1:8000/units                 # Live state of every unit
POST http://127.0.0.1:8000/units/{id}/status     # Advance lifecycle status
POST http://127.0.0.1:8000/units/reallocate      # Confirm a reallocation
POST http://127.0.0.1:8000/units/reset           # Reset the sim roster

Live Unit State (`GET /units`)

[
  {
    "unit_id": "Fire Engine FE12",
    "vehicle_type": "FIRE_ENGINE",
    "lat": 40.7201,
    "lng": -73.996,
    "distance_km": 2.3,
    "eta_minutes": 4,
    "status": "ON_SCENE",
    "assigned_incident": "RESQ-SEED3",
    "assigned_severity": "Normal"
  }
]

Reallocation Suggestion

When no unit is free, /analyze returns a reallocation block instead of null:

{
  "reallocation": {
    "unit_id": "Fire Engine FE12",
    "from_incident": "RESQ-SEED3",
    "from_severity": "Normal",
    "to_severity": "Critical",
    "eta_minutes": 4,
    "message": "No Fire Engine available. FE12 is on a Normal-priority job and can be reallocated to this Critical incident (4 mins ETA)."
  }
}

Confirm Reallocation (`POST /units/reallocate`)

{
  "unit_id": "Fire Engine FE12",
  "incident_id": "RESQ-A1B2",
  "severity": "Critical"
}

📊 Performance

Metric	Value	Status
🎤 Transcription Latency	<1.5s	🟢
🧠 AI Analysis Time	~2-3s	🟢
📋 Form Auto-fill	Instant	🟢
🗺️ Map Rendering	60 FPS	🟢

🌐 Browser Support


80+ ✅	76+ ✅	14+ ⚠️	80+ ✅
Recommended	Full Support	Limited Speech API	Full Support

🔐 Security

🔒	Feature	Description
✅	Encrypted Channels	All communications secured
✅	No Persistent Storage	Sensitive call data not stored
✅	Client-side Processing	Privacy-first voice handling
✅	Secure API	Protected backend communication

🚧 Roadmap

    🎯 CURRENT                    🔮 FUTURE
    ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
    
    ✅ Real-time transcription    ⬜ Multi-language support
    ✅ AI incident analysis       ⬜ Analytics dashboard
    ✅ Auto-form filling          ⬜ CAD integration
    ✅ Tactical map               ⬜ Mobile app
    ✅ Unit dispatch              ⬜ Voice biometrics
    ✅ Live unit tracking         ⬜ Predictive ML
    ✅ Auto-reallocation
    ✅ Geocoded live routing
    ✅ Premium black UI

🛠️ Scripts

npm run dev      # 🔥 Development server with HMR
npm run build    # 📦 Production build
npm run preview  # 👀 Preview production build
npm run lint     # 🔍 ESLint analysis

🤝 Contributing

We welcome contributions from the community!

📄 License

Released under the MIT License

See LICENSE for details

💖 Built with passion for first responders

⏱️ Saving seconds to save lives

_{Made with ❤️ by the ResQ Team}

Name		Name	Last commit message	Last commit date
Latest commit History 63 Commits
.kiro/steering		.kiro/steering
backend		backend
frontend		frontend
.gitignore		.gitignore
README.md		README.md

Folders and files

Latest commit

History

Repository files navigation

🎯 Real-time Emergency Response Management System