Skip to content

@WorldFlowAI WorldFlowAI

All

    Repositories list

    13 repositories

    • semblend-vllm-connector

      Public
      Out-of-tree vLLM KVConnector for SemBlend semantic KV donor discovery
      kv-cachevllmllm-inference
      kv-cachevllmllm-inferencesemantic-kvsemblend
      Python
      •
      Apache License 2.0
      •1•1•0•4•Updated Sep 16, 2026Sep 16, 2026

    • semblend

      Public
      Semantic KV cache reuse for LLM inference engines (vLLM, SGLang)
      Python
      •
      Other
      •2•6•1•0•Updated Sep 16, 2026Sep 16, 2026

    • sembench

      Public
      SemBench: benchmark suite for semantic KV cache reuse
      Python
      •0•1•0•0•Updated Sep 14, 2026Sep 14, 2026

    • sglang

      Public
      SGLang is a high-performance serving framework for large language models and multimodal models.
      Python
      •
      Apache License 2.0
      •8.9k•1•0•1•Updated Sep 13, 2026Sep 13, 2026

    • vllm

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •22k•2•0•0•Updated Sep 3, 2026Sep 3, 2026

    • peregrine

      Public
      FFmpeg for AI inference: a pure-C inference engine with hand-written assembly (no intrinsics), x86-64 + ARM, runtime CPU dispatch.
      cmachine-learningperformance
      cmachine-learningperformanceneonassemblysimdavx2inference-enginellmhand-written-assembly
      C
      •
      BSD 2-Clause "Simplified" License
      •0•1•0•1•Updated Jun 21, 2026Jun 21, 2026

    • dynamo

      Public
      A Datacenter Scale Distributed Inference Serving Framework
      Rust
      •
      Other
      •1.6k•1•0•0•Updated Jun 17, 2026Jun 17, 2026

    • dynamo-fork

      Public
      A Datacenter Scale Distributed Inference Serving Framework
      Rust
      •
      Other
      •1.6k•1•0•0•Updated Mar 27, 2026Mar 27, 2026

    • LMCache

      Public
      Supercharge Your LLM with the Fastest KV Cache Layer
      Python
      •
      Apache License 2.0
      •1.9k•1•0•0•Updated Mar 18, 2026Mar 18, 2026

    • litellm-to-synapse

      Public
      Migration tool for moving from LiteLLM to Synapse — converts LiteLLM YAML config to Synapse API payloads
      Python
      •0•1•0•0•Updated Mar 13, 2026Mar 13, 2026

    • tutorials

      Public
      This repository contains tutorials and examples for Triton Inference Server
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •156•0•0•0•Updated Feb 25, 2026Feb 25, 2026

    • synapse-memory

      Public
      MCP server for Claude Code — persistent session memory with zero infrastructure
      TypeScript
      •
      Other
      •2•5•0•0•Updated Feb 20, 2026Feb 20, 2026

    • everything-claude-code

      Public
      Claude Code toolkit - agents, commands, skills, rules, and hooks for productive AI-assisted development
      JavaScript
      •467•3k•6•4•Updated Jan 23, 2026Jan 23, 2026
    ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.