Skip to content
#

key-value-cache

Star

Here are 3 public repositories matching this topic...

Language: All
Filter by language
All 3 C++ 1 JavaScript 1 Python 1

rukenx / attention-by-hand

Star 1

Transformer attention, worked through numerically; from self-attention and RoPE to KV cache, MQA, and GQA.

nlp key-value transformers pytorch attention attention-mechanism nlp-machine-learning attention-model attention-is-all-you-need multi-query attention-mechanisms pytorch-implementation multi-query-attention kv-cache transformers-models grouped-query-attention key-value-cache kv-cache-optimization kv-cache-management
  • Updated Aug 18, 2026
  • Python

Djninja926 / cachelib-sosp23

Star 1

This repository is a CacheLib prototype of TARDIS, a learned cache eviction policy as part of the LDOS Expeditions project at UT Austin. It implements LRUForgive and S3FIFOForgive with a log-structured multithreaded architecture, and is evaluated against LRU & S3FIFO on real traces to to measure miss-ratio improvement under high eviction pressure.

machine-learning cache lru machine-learning-algorithms tardis log-structured lru-cache sigcomm storage-systems spsc-queue ldos cache-eviction-policy cachelib mulithreading s3fifo systems-ml key-value-cache cache-re cache-evi learned-systems
  • Updated Sep 4, 2026
  • C++

Add this topic to your repo

To associate your repository with the key-value-cache topic, visit your repo's landing page and select "manage topics."

Learn more