minGRU

Implementation of minGRU in Rust using the candle framework.

This is a port of minGRU-pytorch as a small experiment to get more familiar with candle.

Not finished yet, still work in progress.

Usage

Download enwiki8.gz and put it in data/ folder inside this repo. Then:

cargo run -r

It will launch training with character level tokeninzation.

Citations

@inproceedings{Feng2024WereRA,
    title   = {Were RNNs All We Needed?},
    author  = {Leo Feng and Frederick Tung and Mohamed Osama Ahmed and Yoshua Bengio and Hossein Hajimirsadegh},
    year    = {2024},
    url     = {https://api.semanticscholar.org/CorpusID:273025630}
}