Skip to content
#

run-llm-locally

Star

Here are 5 public repositories matching this topic...

Language: All
Filter by language
All 5 Python 2 TypeScript 2

tetherto / qvac

Star 583

Open-source local AI SDK - run AI on-device with no cloud, no API keys. Supports GGUF, RAG, image, music, and video generation, speech-to-text, P2P inference, and more. Cross-platform: Linux, macOS, Windows, Android, iOS.

nodejs python typescript llama whisper ai-sdk on-device-ai stable-diffusion local-llm llm-inference local-ai open-source-llm open-source-ai decentralized-ai open-source-rag openai-compatible local-fine-tuning run-llm-locally p2p-ai open-source-speech-to-text
  • Updated Sep 4, 2026
  • TypeScript

qwen3-8-27b-app / qwen3.8-27b

Star 1

Run Qwen3.8-27B locally in one click — Opus-4.6-level coding on your gaming GPU. Auto-tuned quant, free, fully private, offline. 12GB+ (works on 8GB). Win/Mac/Linux.

one-click-installer llama-cpp local-llm local-ai qwen gguf offline-ai offline-ai-model private-ai apache-2-0-license ai-coding-assistant apache-2-0 run-llm-locally offline-ai-assistant private-ai-assistant qwen3-8-27b qwen-27b local-coding-model opus-alternative gemma-alternative
  • Updated Aug 20, 2026
  • Python

Add this topic to your repo

To associate your repository with the run-llm-locally topic, visit your repo's landing page and select "manage topics."

Learn more