(SMG) Shepherd Model Gateway official documentation, designed by studio-noiich.
-
Updated
Aug 11, 2026 - Svelte
#
prefill-decode-disaggregation
Here are 2 public repositories matching this topic...
Prefill/decode disaggregation for LLM serving on RBLN-CA25 NPUs (vllm_rbln optimum path) + heterogeneous GPU→NPU KV bridge (dlfloat16, verified cos=0.9997). Deployable kits with paste-in runbooks.
-
Updated
Jul 13, 2026
Improve this page
Add a description, image, and links to the prefill-decode-disaggregation topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the prefill-decode-disaggregation topic, visit your repo's landing page and select "manage topics."