Nearest Neighbor at Every Length: Rank-One Softmax and Hardmax Transformers DOI: https://doi.org/10.5281/zenodo.21698621
transformers attention softmax preprint expressivity low-rank context-length nearest-neighbor-retrieval hardmax
-
Updated
Aug 23, 2026 - TeX