zjukg/KnowPAT

score

nihaowz opened this issue · 1 comments

May I ask how your answers are ranked and scored? Is it just 4, 3, 2, 1?

Hello, the answers are ranked by rule-based methods. In our paper, we rank the different answers due to the LLM's ability or the background knowledge quality. The details can be found in our paper. The scores such as 1,2,3,4 just represent the relative preference of each answer.