OpenBioLink/ThoughtSource

mawps dataset cot incorrect

Opened this issue · 0 comments

The COT of id 3 is partially the COT of id 2. Something is mixed up...

{
"id":"2"
"ref_id":""
"question":"One pencil weighs 28.3 grams. How much do 5.0 pencils weigh?"
"type":"number"
"choices":[]
"context":""
"cot":[
0:
"We multiply 28.3 by 5.0 and get 141.5."
]
"answer":[
0:
"141.5"
]
"generated_cot":[]
"feedback":[]
}

{
"id":"3"
"ref_id":""
"question":"Zoe was unboxing some of her old winter clothes. She found 8.0 boxes of clothing and inside each box there were 4.0 scarves and 6.0 mittens. How many pieces of winter clothing did Zoe have total?"
"type":"number"
"choices":[]
"context":""
"cot":[
0:
"We multiply 28.3 by 5.0 and get 141.5. add 4.0 to 6.0 and get 10.0."
1:
"Then we multiply 8.0 by 10.0 and get 80.0."
]
"answer":[
0:
"80.0"
]
"generated_cot":[]
"feedback":[]
}