#

scaled-dot-product-attention

Here are 7 public repositories matching this topic...

monk1337 / Various-Attention-mechanisms

This repository contain various types of attention mechanism like Bahdanau , Soft attention , Additive Attention , Hierarchical Attention etc in Pytorch, Tensorflow, Keras

keras pytorch attention attention-mechanism attention-model attention-mechanisms bahdanau-attention self-attention attention-lstm multi-head-attention hierarchical-attention sentence-attention luong-attention attention-network scaled-dot-product-attention

Updated Sep 23, 2021
Python

johnSHLee96 / attentions_pytorch

A repository for implementations of attention mechanism by PyTorch.

pytorch attention attention-mechanism multihead-attention dot-product-attention scaled-dot-product-attention

Updated Aug 1, 2022
Python

Khanz9664 / attention

Pure C implementation of scaled dot-product attention from Attention Is All You Need, including Query, Key, Value projections and attention-weight computation—the core mechanism behind Transformers and LLMs.

c nlp machine-learning deep-learning transformers attention attention-is-all-you-need scaled-dot-product-attention

Updated Jul 1, 2026
C

Hamidreza-Talei / decoder-only-transformer-from-scratch

A decoder-only Transformer implemented from scratch in PyTorch for character-level name generation.

natural-language-processing deep-learning transformers text-generation language-modeling pytorch transformer autoregressive character-level self-attention multi-head-attention positional-encoding transformer-from-scratch scaled-dot-product-attention temperature-sampling causal-attention decoder-only-transformer

Updated Aug 17, 2026
Jupyter Notebook

peymanpro / HowAttentionWorks

A from-scratch AI project exploring how attention works, learns, and propagates gradients using Python and NumPy.

python machine-learning deep-learning numpy artificial-intelligence attention gradient-descent backpropagation self-attention scaled-dot-product-attention

Updated Aug 26, 2026
Python

NilayGaitonde / Attention

Machine translation and Sentiment Analysis with the (scaled dot product) attention mechanism

sentiment-analysis nmt attention-mechanism scaled-dot-product-attention

Updated Sep 20, 2024
Jupyter Notebook

SrinithiSaiprasath / Transformer

Transformer based chatbot based on "Attention is all you need"

tensorflow transformer nlp-machine-learning keras-neural-networks encoder-decoder-model recurrent-neural-network self-attention multihead-attention-networks positional-encoding scaled-dot-product-attention

Updated Aug 29, 2024
Jupyter Notebook

Add this topic to your repo

To associate your repository with the scaled-dot-product-attention topic, visit your repo's landing page and select "manage topics."