flash-sink

Here is 1 public repository matching this topic...

kelvindelrosario / flash-attention-with-sink

🐙 Implements Flash Attention with sink for gpt-oss-20b; includes test.py. WIP backward pass, varlen support, and community sync to return softmax_lse only.

flash attention sink with flash-attention attention-sink flash-with flash-sink attention-with with-sink flash-attention-with flash-attention-sink flash-with-sink attention-with-sink flash-attention-with-sink

Updated Sep 7, 2026
Python

Add this topic to your repo

To associate your repository with the flash-sink topic, visit your repo's landing page and select "manage topics."

Learn more