Skip to content
@moonmath-ai

MoonMath.ai

Private AI inference, engineered for performance.
MoonMath.ai

We are a small team of mathematicians and engineers building faster LLM inference through low-level algorithms, systems engineering, custom kernels, and hardware-aware optimization — with a focus on coding models and agentic workloads.

Zro: Fast inference for coding agents

Zro is MoonMath's private inference platform built for coding agents. It gives developers fast access to leading open-weight coding models through a single endpoint, optimized for long-context, multi-turn agentic workloads.

  • Built for coding agents: Connect Claude Code, Codex, OpenCode, Cline, and more in minutes.
  • Accelerated inference: Our serving stack is engineered for high-throughput, low-latency LLM inference.
  • Private by default: Zero request retention and no training on customer data.
  • Open models, one endpoint: Run capable open-weight coding models without managing GPUs, inference engines, or serving infrastructure yourself.
  • Performance from the stack down: MoonMath combines algorithmic optimization, custom kernels, compression, and hardware-aware deployment to push more performance from modern accelerators.

→ Start coding with Zro

MoonLite: LLM acceleration research & tooling

MoonLite is MoonMath's collection of low-level techniques and tools for making large models faster and more efficient:

  • LiteLinear: decomposed modules designed to replace standard FFN layers with more efficient alternatives.
  • BackLite: FlashAttention 3-based backward-pass acceleration using sparse gradient approximation.
  • LiteAttention: sparse attention techniques for accelerating large generative models.
  • LiteRunner: experiment infrastructure for benchmarking and developing model acceleration techniques, with local and Weights & Biases tracking.

Links

Pinned Loading

  1. LiteAttention LiteAttention Public

    Transforming Video Diffusion with Temporal Sparse Attention

    Python 56 5

  2. LiteLinear LiteLinear Public

    LiteLinear is a drop-in inference acceleration: compress nn.Linear layers via calibration-aware low-rank decomposition + quantization

    8 1

  3. HyperQuant HyperQuant Public

    Python 16 2

  4. amd-kernels amd-kernels Public

    Hand-tuned kernels for AMD Instinct

    C++ 8 2

  5. zro zro Public

    Zro CLI - Easily use your existing agent harnesses and setup with Zro

    TypeScript 5

  6. Sable Sable Public

    Sable prover release

    Python 15 1

Repositories

Showing 10 of 49 repositories
  • zro Public

    Zro CLI - Easily use your existing agent harnesses and setup with Zro

    moonmath-ai/zro's past year of commit activity
    TypeScript 5 MIT 0 0 8 Updated Nov 13, 2026
  • sglang Public Forked from sgl-project/sglang

    SGLang is a high-performance serving framework for large language models and multimodal models.

    moonmath-ai/sglang's past year of commit activity
    Python 2 Apache-2.0 10,490 0 3 Updated Nov 9, 2026
  • Sable Public

    Sable prover release

    moonmath-ai/Sable's past year of commit activity
    Python 15 MIT 1 1 0 Updated Nov 3, 2026
  • aiter Public Forked from ROCm/aiter

    AI Tensor Engine for ROCm

    moonmath-ai/aiter's past year of commit activity
    Python 0 MIT 704 0 0 Updated Nov 3, 2026
  • amd-kernels Public

    Hand-tuned kernels for AMD Instinct

    moonmath-ai/amd-kernels's past year of commit activity
    C++ 8 MIT 2 0 0 Updated Nov 2, 2026
  • moonmath-ai/Qwen3.8-27B-deepcoder-RL's past year of commit activity
    Python 0 Apache-2.0 0 0 0 Updated Nov 1, 2026
  • tinker-cookbook Public Forked from thinking-machines-lab/tinker-cookbook

    Post-training with Tinker

    moonmath-ai/tinker-cookbook's past year of commit activity
    Python 0 Apache-2.0 567 0 0 Updated Nov 1, 2026
  • sglang-jax Public Forked from sgl-project/sglang-jax

    JAX backend for SGL

    moonmath-ai/sglang-jax's past year of commit activity
    Python 0 Apache-2.0 163 0 0 Updated Oct 28, 2026
  • models.dev Public Forked from anomalyco/models.dev

    An open-source database of AI models.

    moonmath-ai/models.dev's past year of commit activity
    TypeScript 0 MIT 2,079 0 1 Updated Oct 23, 2026
  • SpecForge Public Forked from sgl-project/SpecForge

    Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

    moonmath-ai/SpecForge's past year of commit activity
    Python 0 MIT 392 0 0 Updated Oct 22, 2026

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Most used topics

Loading…