Dao AI Lab

Popular repositories Loading

1. flash-attention flash-attention Public

   Fast and memory-efficient exact attention

   Python 24.7k 3k

2. quack quack Public

   A Quirky Assortment of CuTe Kernels

   Python 1.1k 146

3. causal-conv1d causal-conv1d Public

   Causal depthwise conv1d in CUDA, with a PyTorch interface

   Python 936 204

4. sonic-moe sonic-moe Public

   Accelerating MoE with IO and Tile-aware Optimizations

   Python 741 95

5. fast-hadamard-transform fast-hadamard-transform Public

   Fast Hadamard transform in CUDA, with a PyTorch interface

   C 345 69

6. gram-newton-schulz gram-newton-schulz Public

   Fast Polar Decomposition for Muon

   Python 174 14