neatGPT

Install

git clone https://github.com/jon123boss/neatGPT
cd neatGPT
pip install -r requirements.txt --pre --no-build-isolation

The --pre flag is required because flash-attn releases are currently pre-release. The --no-build-isolation flag is required for flash-attn installation.

Data

python prepdata.py

Train

Edit hyperparameters in train.py, then:

python train.py