Closed this issue a year ago · 1 comments
MultiPL-E translates HumanEval to multiple other programming languages. It allows more diverse evaluation and has lower chances of being contained in training sets.
Added HumanEval Rust and MBPP Rust with v2!