LLM speculative inference server for consumer & heterogeneous hardware
-
Updated
Aug 15, 2026 - C++
LLM speculative inference server for consumer & heterogeneous hardware
Add a description, image, and links to the r9700 topic page so that developers can more easily learn about it.
To associate your repository with the r9700 topic, visit your repo's landing page and select "manage topics."