Hi, thanks for your outstanding work.
Here I want to preprocess my own dataset using data_process.sh, but the srcdict and tgtdict files are missing in L24 and L25 below. Could you tell me where to find them?
|
fairseq-preprocess \ |
|
--user-dir mass --task masked_s2s \ |
|
--source-lang src --target-lang tgt \ |
|
--trainpref $DATA_DIR/train \ |
|
--validpref $DATA_DIR/valid \ |
|
--testpref $DATA_DIR/test \ |
|
--destdir $OUT_DIR \ |
|
--srcdict pretrained_model/MASS/dict.txt \ |
|
--tgtdict pretrained_model/MASS/dict.txt \ |
|
--workers 20 |
Hi, thanks for your outstanding work.
Here I want to preprocess my own dataset using data_process.sh, but the srcdict and tgtdict files are missing in L24 and L25 below. Could you tell me where to find them?
TitleStylist/data_process.sh
Lines 17 to 26 in 752a1b8