🧠 🎮 Mission Control — NVIDIA-Powered AI Gaming Platform

An advanced, real-time AI gaming assistant & intelligence ecosystem powering desktop performance, live tactical coaching, dynamic HUD overlays, hardware telemetry, and automated gaming news.

---

📸 Interface & Capabilities Showcase

🖥️ Main Console & Dashboard	🤖 Autonomous AI Co-Pilot & Tactical Agent
📟 Glassmorphic HUD Overlay	🎯 TensorRT AI Vision & YOLO Detection
📊 Real-Time Hardware Telemetry	🔬 Performance Tuning Lab & Power Controls
🎮 Game Library & Auto-Sense Target Routing	⚡ AI Hardware Readiness Matrix
⚙️ System Settings & AI Neural Configuration	🔍 Deep Scanner & Library Auto-Discovery

---

📌 Monorepo Architecture Overview

Mission Control is an integrated platform split into three primary sub-projects designed to deliver ultra-low latency hardware monitoring, local AI vision, and high-performance gaming intelligence:

Mission-Control /
├── 🌐 Gaming/website/        # Next.js 15 (App Router) + Tailwind CSS + MongoDB
│                             # Web platform, documentation hub, and automated AI Gaming Intel blog pipeline.
│
├── 🖥️ Gaming/frontend/       # Electron + React + Vite + TypeScript
│                             # Desktop dashboard, glassmorphic HUD overlay, hotkeys engine, and telemetry UI.
│
├── 📦 Gaming/publisher-gui/  # Electron + Vite + Tailwind CSS
│                             # Build manager, installer generator, & release publishing client GUI.
│
├── 🐍 Gaming/backend/        # Python 3.12 + FastAPI + PyNVML + TensorRT + C++ DirectX DLL
│                             # Local AI brain, C++ FPS engine, TensorRT YOLO vision, hardware monitoring, & voice TTS/STT.
│
├── 📜 run_local.ps1          # Automated local build, package & release runner script.
└── ⚙️ .woodpecker/           # CI/CD pipelines for automated multi-platform desktop releases.

🧱 System Workflow Architecture

👤 USER / GAMER INTERACTION LAYER
🖥️ Electron Desktop Dashboard React + Vite HUD & Telemetry	📦 Publisher GUI Client Builds, Packaging & Releases	🎙️ Voice & Hotkey Controls Mic Toggle & Global Shortcuts
🧠 AI DECISION ENGINE & TASK AUTO-ROUTER
Task Classifier ➔ Dynamic Web Search Engine (Wikipedia | RAWG.io | SteamSpy | DuckDuckGo) Model Router ➔ NVIDIA NIM Cloud AI (Llama 3.1 8B/70B Strategic + Llama 3.2 11B Vision VLM)
⚡ REAL-TIME EXECUTION & TELEMETRY PIPELINES
🎮 Game Vision Pipeline dxcam 60fps ➔ TensorRT YOLOv8 ➔ OCR	🎙️ Voice Engine Google / Sphinx STT ➔ ElevenLabs / SAPI5 TTS	🔧 Hardware Telemetry C++ DirectX FPS DLL + PyNVML + WMI/PDH
📟 GLASSMORPHIC HUD OVERLAY STREAM
Tactical Alerts Cards • Real-time Min/Max FPS & Thermal Bar • Live Subtitles Strip

graph TD
    classDef client fill:#1e293b,stroke:#38bdf8,stroke-width:2px,color:#f8fafc;
    classDef ai fill:#0f172a,stroke:#a855f7,stroke-width:2px,color:#f8fafc;
    classDef cloud fill:#022c22,stroke:#10b981,stroke-width:2px,color:#f8fafc;
    classDef output fill:#1c1917,stroke:#f59e0b,stroke-width:2px,color:#f8fafc;

    User["👤 USER / GAMER"] --> UI["🖥️ ELECTRON CLIENT & INTERFACES<br/><i>Dashboard • Library • Agent Chat • HUD • Settings</i>"]:::client

    subgraph ENGINE ["🧠 MISSION CONTROL ENGINE ARCHITECTURE"]
        direction TB

        UI --> Router["🔍 Task Classifier & Web Search Engine<br/><i>RAG Router • DuckDuckGo • RAWG.io • SteamSpy</i>"]:::ai
        Router --> NIM["⚡ NVIDIA NIM CLOUD AI<br/><i>Llama 3.1 8B/70B Strategic + Llama 3.2 11B Vision VLM</i>"]:::cloud

        NIM --> Voice["🎙️ Voice & Subtitle Engine<br/><i>Google STT • ElevenLabs / SAPI5 TTS</i>"]:::output
        NIM --> Advice["💬 Agent Co-Pilot Advice & Tactical Cards"]:::output

        FrameCap["📸 dxcam 60 FPS Capture"] --> YOLO["🎯 TensorRT YOLOv8 + OCR Vision Engine"]:::ai
        YOLO --> HUD["📟 Glassmorphic HUD Overlay<br/><i>Live Telemetry • Tactical Hints • Min/Max FPS</i>"]:::output
        
        HW["🔧 Native Hardware Telemetry<br/><i>LibreHardwareMonitor • PyNVML • C++ ETW DLL</i>"]:::ai --> HUD
        Voice --> HUD
        Advice --> HUD
    end

    class UI client;
    class Router,YOLO,HW ai;
    class NIM cloud;
    class Voice,Advice,HUD output;

Loading

---

🚀 Sub-Project Quick Links

Component	Stack	Description	Documentation
Web Platform	Next.js 15, TypeScript, Tailwind CSS, MongoDB	Live gaming intelligence web app, benchmark profiles, documentation, and RSS AI blog generator.	Website README
Desktop App	Electron, React, Vite, Tailwind CSS	Real-time desktop application with glassmorphic HUD overlay, hardware telemetry, & keybindings.	Frontend README
Publisher GUI	Electron, Vite, Tailwind CSS	Release packaging, installer generation, release manifest sync & asset publisher client.	Publisher GUI README
Python Backend	Python 3.12, FastAPI, C++, PyNVML, TensorRT	High-frequency telemetry service, native DirectX frame queue monitoring, and NVIDIA AI models.	Backend README
Complete System	Architecture & Versioning	Detailed technical patch notes, agentic logic, and system overview.	System Manual

---

🎯 Key Features

• ⚡ Zero-Latency C++ DirectX FPS Tracking: Native C++ DLL (fps_counter.dll) hooking into low-level presentation queues for 1% lows and instantaneous FPS telemetry without Python overhead.
• 🟢 NVIDIA TensorRT & NIM Acceleration: Pure TensorRT inference for YOLOv8 vision detection with 0 MB PyTorch VRAM waste, paired with NVIDIA NIM (Llama 3.1 & 3.2 Vision) cloud reasoning.
• 🖥️ Glassmorphic HUD Overlay: Dynamic desktop overlay displaying real-time FPS, CPU/GPU temperatures, wattage, and active AI co-pilot tactical suggestions.
• 📰 Automated AI Gaming Intel Blog: Vercel cron-scheduled RSS aggregator (IGN, Kotaku, Eurogamer, AnandTech, Tom's Hardware) running a 3-tier failover LLM pipeline to generate daily technical news saved directly to MongoDB Atlas.
• 🔒 Motherboard UUID Security & HW Telemetry: Cryptographic Motherboard UUID locking, Win32 working set RAM flushing, and hardware telemetry via PyNVML, WMI, and PDH.

---

🛠️ Prerequisites & Requirements

• Operating System: Windows 10 / 11 (64-bit) or Linux (Ubuntu 22.04+, Arch, Fedora x86_64).
• GPU: NVIDIA GeForce GTX / RTX series card (RTX 20, 30, 40, or 50 series recommended for TensorRT & DLSS telemetry).
• Node.js: v18.x or v20.x+
• Python: v3.12 (managed via uv)
• Drivers: NVIDIA Display Drivers R580+ & CUDA Toolkit 12.x+
• Download Packages: Windows (.exe, .msi, .zip) & Linux (.AppImage, .deb, .rpm, .tar.gz) available via GitHub Releases and the web platform.

---

⚡ Quick Start / Local Development

1. Repository Setup

# Clone the repository
git clone https://github.com/arnab825/Mission-Control.git
cd Mission-Control

2. Running the Next.js Web Platform

cd Gaming/website
npm install
npm run dev
# Web app runs at http://localhost:3000

3. Running the Electron Desktop App & Backend

# Terminal 1: Run Python Backend
cd Gaming/backend
uv sync
uv run main.py --dev

# Terminal 2: Run Electron Desktop App
cd Gaming/frontend
npm install
npm run dev

4. Running Automated Local Build Script

# Run the local packaging & release pipeline
.\run_local.ps1

---

🤝 Community & Contributing

We welcome contributions from developers, gamers, and open-source enthusiasts!

• Contributing Guide: Detailed steps on setting up local dev environments, submitting PRs, and testing telemetry modules.
• Good First Issues: Tagged tasks perfect for getting started with the repository.
• System Roadmap: Check upcoming features including multi-vendor AMD RX & Intel Arc telemetry support.

---

📄 License

This repository and open-source codebase are licensed under the Apache License 2.0. See the root LICENSE file and Desktop App EULA for details.