Orbital ML Lab
Open-source experiments in local ML inference, model optimization, and Apple Silicon.
Popular repositories Loading
-
qwen-fp8-mtp-sidecar-for-mtplx
qwen-fp8-mtp-sidecar-for-mtplx PublicRecover the native MTP predictor missing from the 8-bit MLX Qwen3.8-27B-Uncensored package, build a BF16 sidecar, and reproduce a 15.59 → 48.75 tok/s controlled M4 Max result with MTPLX.
Python
Repositories
Showing 1 of 1 repositories
- qwen-fp8-mtp-sidecar-for-mtplx Public
Recover the native MTP predictor missing from the 8-bit MLX Qwen3.8-27B-Uncensored package, build a BF16 sidecar, and reproduce a 15.59 → 48.75 tok/s controlled M4 Max result with MTPLX.
People
This organization has no public members. You must be a member to see who’s a part of this organization.
Top languages
Loading…
Most used topics
Loading…