Name		Name	Last commit message	Last commit date
LICENSE		LICENSE
README.md		README.md
gpt.py		gpt.py
gpt_V1.ipynb		gpt_V1.ipynb
shakespeare.txt		shakespeare.txt
shakespeare_char_llm.py		shakespeare_char_llm.py
wiki_1.py		wiki_1.py
wiki_2.py		wiki_2.py

Repository files navigation

Wikipedia-GPT

A simple GPT model trained on Wikipedia Dataset.

Here in gpt.py, we have a simple Bigram Language Model.

In gpt1.py, we have a simple Bigram Language model with a single head of self-attention.

About

A simple GPT model trained on Wikipedia Dataset.

0 stars

1 watching

Report repository

Releases

Packages

Contributors

Languages