Thanks for publishing this resource. I think I might be able to build a learning tool from it.
When I go and look at dev-anno.001_zh.001_en.tsv, GitHub displays this warning:
We can make this file beautiful and searchable if this error is corrected: Illegal quoting in line 11.
Most of the other TSV files have the same warning, but dev-anno.002_zh.002_en.tsv doesn't, so you can see what the "beautiful and searchable" mode looks like.
The problem is that intertext2tsv.py uses simple string concatenation, and doesn't escape quotes. I'll create a pull request that converts it to using the csv module.
Thanks for publishing this resource. I think I might be able to build a learning tool from it.
When I go and look at
dev-anno.001_zh.001_en.tsv, GitHub displays this warning:Most of the other TSV files have the same warning, but
dev-anno.002_zh.002_en.tsvdoesn't, so you can see what the "beautiful and searchable" mode looks like.The problem is that
intertext2tsv.pyuses simple string concatenation, and doesn't escape quotes. I'll create a pull request that converts it to using thecsvmodule.