Maluuba/nlg-eval

meteor issue

520jefferson opened this issue · 1 comments

The meteor don't have the chinese word data, and the meteor mainpage don't have too.
whether it's not proper to evaluate chinese nlg task using meteor ?

Yes, Chinese doesn't seem to be supported by METEOR: https://www.cs.cmu.edu/~alavie/METEOR/README.html. Some of the other metrics would work but we don't provide tokenizers for Chinese. If you can handle that you should be able to make the other metrics work.