Could I get all statistics?
Closed this issue · 2 comments
sh0416 commented
I want to get all statistics come from this wonderful research, or at least about humaneval dataset.
Could I get the material or link to follow? It seems that the paper does not report exact values about the Figure.
arjunguha commented
Yes! So the original analyses are here: https://github.com/nuprl/MultiPL-E/tree/main/analysis
The raw data is also available here: https://huggingface.co/datasets/bigcode/MultiPL-E-completions
sh0416 commented
Great! Thanks for your quick support :)