hsiehjackson/RULER

Tempate for Yi?

liyucheng09 opened this issue · 2 comments

Great job for this project!

Can we have the template you used for the evaluation of Yi?
Or did you simply use the meta-chat for Yi?

Please let me know for the sake of reproducibility!

@liyucheng09 we use "base" template without any special tokens for the evaluation of Yi.

Thanks for your response. I tried meta-chat and found only minor divergence.