Name		Name	Last commit message	Last commit date
Latest commit History 14 Commits
data		data
.gitattributes		.gitattributes
.gitignore		.gitignore
.python-version		.python-version
README.md		README.md
app.py		app.py
config.py		config.py
inference.py		inference.py
model.pt		model.pt
model.py		model.py
pyproject.toml		pyproject.toml
train.py		train.py
uv.lock		uv.lock

Repository files navigation

GPTDecoded

References

Attention is all you need

FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning

About

A 124M-parameter GPT-style language model built and trained from scratch in PyTorch, with optimized attention, mixed-precision training, and interactive text generation.

Report repository

Releases

Packages

Contributors

Languages