Wikipedia-GPT A simple GPT model trained on Wikipedia Dataset. Here in gpt.py, we have a simple Bigram Language Model. In gpt1.py, we have a simple Bigram Language model with a single head of self-attention.