Skip to content

fix: apply QK norm in MultiheadAttention hook methods - #85

Open
orrzohar wants to merge 1 commit into
Cerebras:mainfrom
orrzohar:fix/apply-qk-norm-in-attention-hooks
Open

fix: apply QK norm in MultiheadAttention hook methods#85
orrzohar wants to merge 1 commit into
Cerebras:mainfrom
orrzohar:fix/apply-qk-norm-in-attention-hooks

fix: apply QK norm in MultiheadAttention hook methods

1c454e5
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs