Definition of `big` number?
sieu-n opened this issue · 2 comments
sieu-n commented
How do I compute the big metric from the paper(48 for GPT4)?
sieu-n commented
I noticed that it is sort of implied in the paper that cases > 1e12 are considered big, so I suspect it is based on the ground-truth value of the answer. Just to make sure though.
GanjinZero commented
You are right.