Name		Name	Last commit message	Last commit date
data		data
figures		figures
.DS_Store		.DS_Store
GD_Adam.py		GD_Adam.py
GD_L1.py		GD_L1.py
GD_L2_symm.py		GD_L2_symm.py
GD_seq2seq.py		GD_seq2seq.py
README.md		README.md
loss.py		loss.py
state_evolution.py		state_evolution.py
state_evolution_powerlaw.py		state_evolution_powerlaw.py
test_error.py		test_error.py

Repository files navigation

ExtensiveAttention

Repository for the paper "Inductive Bias and Spectral Properties of Single-Head Attention in High Dimensions"

About

Repository for the paper "Inductive Bias and Spectral Properties of Single-Head Attention in High Dimensions"

Custom properties

1 star

0 watching

Report repository

Releases

Packages

Contributors

Languages