rtx-2060

Here is 1 public repository matching this topic...

yuuki-net / FreeToken-Kai

Unofficial FreeToken fork: Turing (RTX 20 series) support, image input over the OpenAI API, MTP speculative decoding, 64k context on an RTX 2060 6 GB, and layer-split serving over two consumer GPUs (Qwen3.8-Flash-Next with 128k context on two RTX 3060 12 GB, no NCCL). Written by Claude Fable 5.1.

moe llm-inference speculative-decoding qwen3 freetoken nvidia-turing rtx-2060

Updated Sep 6, 2026
Python

Add this topic to your repo

To associate your repository with the rtx-2060 topic, visit your repo's landing page and select "manage topics."

Learn more