Difference with nordic_bert? Thanks
Closed this issue · 2 comments
Excellent work. I guess the authors must be aware of nordic_bert (https://github.com/botxo/nordic_bert). Have you compared with that pretrained model? But at least one difference is that NorBERT is implemented in Torch, while nordic_bert is based on TensorFlow. Is that correct?
The model you mention is broken with regards to Norwegian: at least, we are not aware of anyone who successfully used it for any Norwegian NLP task. So it does not make sense to compare.
As for TF and PyTorch, not sure what you mean. NorBERT was trained using TensorFlow, but we provide the model in two variants.
There are many more details in our paper, please check it!
The model you mention is broken with regards to Norwegian: at least, we are not aware of anyone who successfully used it for any Norwegian NLP task. So it does not make sense to compare.
As for TF and PyTorch, not sure what you mean. NorBERT was trained using TensorFlow, but we provide the model in two variants.
There are many more details in our paper, please check it!
Great that two variants were provided. Sorry I have not read your paper yet, will do it soon. Thanks a lot for the excellent work.