eric-mitchell/mend

the QA cases comparing pre- and post- edit in paper cannot be found from the dataset, where can we find the cases, such as “Who design the Burj Khalifa?”

LeiyanGithub opened this issue · 1 comments

the QA cases comparing pre- and post- edit in paper cannot be found from the dataset, where can we find the cases, such as “Who design the Burj Khalifa?”

These prompts were manually constructed (typed in by hand) and evaluated with a pre-trained MEND model.