#

position-embedding

Here are 12 public repositories matching this topic...

thu-ml / DiT-Extrapolation

Official implementation for "RIFLEx: A Free Lunch for Length Extrapolation in Video Diffusion Transformers" (ICML 2025) , UltraViCo (ICLR 2026) and UltraImage

generative-model rope diffusion extrapolation dit video-generation position-embedding diffusion-models long-video-generation diffusion-transformer cogvideox hunyuan-video

Updated Mar 8, 2026
Python

naver-ai / rope-vit

[ECCV 2024] Official PyTorch implementation of RoPE-ViT "Rotary Position Embedding for Vision Transformer"

transformer self-attention position-embedding vision-transformer rotary-position-embedding eccv2024

Updated Oct 29, 2025
Python

erogol / BlaGPT

Experimental playground for benchmarking language model (LM) architectures, layers, and tricks on smaller datasets. Designed for flexible experimentation and exploration.

machine-learning deep-learning transformers pytorch gpt attention-mechanisms gpt-2 position-embedding large-language-models llm llm-training hymba diffusion-llm dllm

Updated May 6, 2026
Python

cosmaadrian / time-enriched-multimodal-depression-detection

Official source code for the paper: "It’s Just a Matter of Time: Detecting Depression with Time-Enriched Multimodal Transformers"

multimodal-learning transformer-architecture depression-detection position-embedding

Updated Jan 17, 2024
Python

Haochen-Wang409 / DropPos

[NeurIPS'23] DropPos: Pre-Training Vision Transformers by Reconstructing Dropped Positions

computer-vision deep-learning detection imagenet image-classification coco segmentation ade20k self-supervised-learning position-embedding vision-transformer neurips-2023

Updated Apr 30, 2024
Python

yhlleo / MJP

[CVPR 2023] An official Pytorch implementation of "Masked Jigsaw Puzzle: A Versatile Position Embedding for Vision Transformers".

privacy-protection position-embedding vision-transformer gradient-attack

Updated Dec 21, 2024
Python

hrlics / HoPE

[NeurIPS 2025] HoPE: Hybrid of Position Embedding for Long Context Vision-Language Models

position-embedding long-video-understanding long-context-modeling vision-language-models

Updated Feb 19, 2026
Python

CyberZHG / torch-position-embedding

Position embedding in PyTorch

pytorch embeddings position-embedding

Updated Jul 11, 2020
Python

akanyaani / embedding-visualizer

Word and Position Embedding visualization of all pre-trained transformer models like BERT

word-embeddings embeddings transformer tensorboard-visualizations position-embedding bert-embeddings embedding-visualization

Updated Aug 15, 2021
Jupyter Notebook

woodyycchang / RoPE-concept-demo-website

Interactive visual explainer for Rotary Position Embedding (RoPE) used in LLaMA, Qwen, Mistral

transformer educational cornell interactive-visualization rope position-embedding llm

Updated Apr 25, 2026
JavaScript

lartpang / RotaryPositionEmbedding

rope position-embedding

Updated Mar 28, 2024
Jupyter Notebook

Offei-op / position-embeddings-bengio-mlp

Does a position embedding help a character-level Bengio MLP? Experimental study with parameter-matched controls and a context-length sweep.

machine-learning mlp language-model character-level position-embedding makemore karpathy-inspired

Updated May 28, 2026
Jupyter Notebook

Improve this page

Add a description, image, and links to the position-embedding topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the position-embedding topic, visit your repo's landing page and select "manage topics."