You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The scope section still said there was no OpenAI-compatible serving of real
weights, which the opening of the same README now disproves. A reader would
reasonably conclude nobody checked.
It now says what is actually true. Real weights are served over an OpenAI-shaped
endpoint, one request at a time, with no batching, no scheduling, no
multi-tenancy and no auth, because the KV cache holds one sequence.
The reduced-scale claim was also ambiguous once two model paths exist, so it now
separates them. OLMo runs full depth and full vocabulary from a real checkpoint.
The Qwen path is a synthetic-weight proof at reduced scale and says so.
Adds two claims that were missing rather than wrong. FP4 KV output is coherent
but unmeasured against an FP16 baseline. Performance is unoptimised, at about
125 ms/token with a host round trip per layer.
Also replaces an 'as above' that no longer referred to anything.
0 commit comments