baaivision/JudgeLM

How to prompt for single answer without reference?

Opened this issue · 1 comments

What is the proper way to prompt JudgeLM for single answer + reference free evaluation?

The paper talks about this, but I don't see any explicit examples in the appendix nor in the hosted demo

You need to track the code files. Prompts are given here

then you can use this code to infer on you individual ones. I'm working on same so figured out how to refactor the code.

@andrewrreed