Measured SM121 compatibility recipe for MiniMax H3 FL2VA on one NVIDIA DGX Spark with vLLM-Omni and online FP8.
-
Updated
Aug 4, 2026 - Python
Measured SM121 compatibility recipe for MiniMax H3 FL2VA on one NVIDIA DGX Spark with vLLM-Omni and online FP8.
AI-native long-form video studio with hidden storyboard orchestration and pluggable generation backends.
Run full MiniMax-H3 FL2VA on one RTX A6000: 1344x768 video + stereo audio, 6.16x Turbo, and formal Sol-Attn N=10.
Thin browser frontend for vLLM-Omni video generation, queue, random seeds, reproducible results. Single file, stdlib only.
Local DGX Spark deployment wrapper for Qwen3-Omni GPTQ4 with multimodal CLI, skills, and packaging scripts
Web UI for the Qwen-Image-2.1 vLLM-Omni recipe (recipes.vllm.ai/Qwen/Qwen-Image-2.1): text-to-image, edits with reference-size output, chat image path, diagnostics. UI only - no weights, no server.
Production-style async serving for image-editing/generation diffusion models via two interchangeable backends — vLLM Omni and SGLang — with FastAPI gateways, Celery + Redis job queues, Docker Compose, and a React frontend.
Web-based control panel for self-hosted LLM inference on NVIDIA GPUs — vLLM, MIG, LiteLLM gateway, HTTPS, monitoring.
Streaming inference optimizations for IndexTTS 1.5 / 2 / 2.5: incremental Mel decoding, first-chunk latency and vLLM-Omni integration.
MiniCPM-o 4.5 inference optimization on Ascend 910C with vLLM-Omni
High-concurrency async TTS server that serves Qwen3-TTS-12Hz-1.7B-Base with pre-computed speaker embeddings on a custom vLLM-Omni fork
Reproducible vLLM-Omni serving and benchmark reference for NVIDIA Cosmos3-Super on H200 and B200 GPUs
To associate your repository with the vllm-omni topic, visit your repo's landing page and select "manage topics."