fast-llm

Here is 1 public repository matching this topic...

One import, zero config, maximum tokens/sec. Intelligently orchestrating local LLMs and hybrid speculative decoding.

ai llm local-llm run-llm-locally fast-llm how-to-run-llm-fast

To associate your repository with the fast-llm topic, visit your repo's landing page and select "manage topics."