mawps dataset cot incorrect
Opened this issue · 0 comments
The COT of id 3 is partially the COT of id 2. Something is mixed up...
{
"id":"2"
"ref_id":""
"question":"One pencil weighs 28.3 grams. How much do 5.0 pencils weigh?"
"type":"number"
"choices":[]
"context":""
"cot":[
0:
"We multiply 28.3 by 5.0 and get 141.5."
]
"answer":[
0:
"141.5"
]
"generated_cot":[]
"feedback":[]
}
{
"id":"3"
"ref_id":""
"question":"Zoe was unboxing some of her old winter clothes. She found 8.0 boxes of clothing and inside each box there were 4.0 scarves and 6.0 mittens. How many pieces of winter clothing did Zoe have total?"
"type":"number"
"choices":[]
"context":""
"cot":[
0:
"We multiply 28.3 by 5.0 and get 141.5. add 4.0 to 6.0 and get 10.0."
1:
"Then we multiply 8.0 by 10.0 and get 80.0."
]
"answer":[
0:
"80.0"
]
"generated_cot":[]
"feedback":[]
}