Hi-archers/MLaKE

Some errors in the released dataset?

whr94621 opened this issue · 2 comments

whr94621 commented

See https://github.com/Hi-archers/MLaKE/blob/main/dataset/multi_hop/mcqa/new_zh_mcqa.json#L91

I think the University of Cambridge is not located in United States?

whr94621 commented

Sorry I get messed up... This is the benchmark after knowledge editing...

Hi-archers commented

Thank you for your attention to our work. It was an oversight on our part, and we will soon update the README to explain how to use our benchmark.

  • 👍1