/QARV

Primary LanguageJupyter NotebookMIT LicenseMIT

QARV (Question and Answers with Regional Variance)

EleutherAI Community Project

The QARV (Question and Answers with Regional Variance) project aims to curate a collection of questions with answers that exhibit regional variations across different nations.

How to run.

You can run evaluations as following:

python evaluate.py --model_name "Qwen/Qwen2-7B" --output_path "results"