EleutherAI Community Project
The QARV (Question and Answers with Regional Variance) project aims to curate a collection of questions with answers that exhibit regional variations across different nations.
You can run evaluations as following:
python evaluate.py --model_name "Qwen/Qwen2-7B" --output_path "results"