a-cup-of-ai

Popular repositories Loading

1. arle arle Public

   Pure-Rust LLM runtime: one binary serves (OpenAI-compatible), runs local agents, and distills models on their own rollouts — on Apple Silicon and NVIDIA. No Python on the hot path.

   Rust 18

2. eli eli Public

   Ease Lives Instantly

   Rust 5

3. mini-llm mini-llm Public

   Python 2

4. kernel-set kernel-set Public

   High-performance CUDA kernels for LLM inference & training — callable from Python, Rust, Go, and TypeScript through one stable C ABI.

   Python 2

5. Crayon Crayon Public

   ray in rust

   Rust 2

6. aupai aupai Public

   Python