the label of WSC task is all true?
suolyer opened this issue · 1 comments
suolyer commented
the label of WSC task is all true，no false
timoschick commented
Hi @suolyer, this is because in prompting work, WSC is typically framed as a generative task. That is, instead of classifying whether a (pronoun, entity) pair is correct, the entity a pronoun is referring to has to be generated. You can find more information about that on page 5 of our paper (the section about WSC). Therefore, it only makes sense to use examples where the label is true.