Skip to content

Replace the FA3 attention backend with FlashAttention-4 (Hopper and Blackwell) - #1291

Open
tolleybot wants to merge 13 commits into
PriorLabs:mainfrom
tolleybot:fa4-backend
Open

Replace the FA3 attention backend with FlashAttention-4 (Hopper and Blackwell)#1291
tolleybot wants to merge 13 commits into
PriorLabs:mainfrom
tolleybot:fa4-backend

Split-KV at batch > 1 for any KV length; skip 2-way splits

5b5bb89
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs