Hi,
I am wondering, have you tried any of the German-specific transformer options available on HF? For example
https://huggingface.co/google-bert/bert-base-german-cased
https://huggingface.co/dbmdz/bert-base-german-cased (or uncased)
https://huggingface.co/german-nlp-group/electra-base-german-uncased
In my experiments, I generally find the language specific transformers work better than multilingual ones such as XLM-R, and I would like to make apple-to-apples comparisons when comparing a constituency parser I am working on to other models such as yours.
Thanks!
Hi,
I am wondering, have you tried any of the German-specific transformer options available on HF? For example
https://huggingface.co/google-bert/bert-base-german-cased
https://huggingface.co/dbmdz/bert-base-german-cased (or uncased)
https://huggingface.co/german-nlp-group/electra-base-german-uncased
In my experiments, I generally find the language specific transformers work better than multilingual ones such as XLM-R, and I would like to make apple-to-apples comparisons when comparing a constituency parser I am working on to other models such as yours.
Thanks!