Skip to content
#

gpu-orchestration

Here are 7 public repositories matching this topic...

Language: All
Filter by language

Self-hosted multi-agent AI platform. Persistent labs, 40 sandboxed tools (code, web, RAG, GPU dispatcher, web3), private Qdrant + LightRAG, sandboxed code execution per lab, anti-loop detection, Ollama/vLLM/OpenAI/Anthropic adapters. Two-command Docker deploy. Apache 2.0.

  • Updated Jun 7, 2026
  • Python

Distributed document RAG system with intelligent GPU/CPU orchestration. Auto-discovers heterogeneous nodes, routes workloads adaptively, and achieves 60x+ speedups through VRAM-aware load balancing. Privacy-first architecture with 4 interfaces (CLI, API, MCP, Web UI). Real distributed systems engineering, not just an API wrapper.

  • Updated Nov 13, 2025
  • Python

Improve this page

Add a description, image, and links to the gpu-orchestration topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the gpu-orchestration topic, visit your repo's landing page and select "manage topics."

Learn more