prometheus-eval/prometheus
[ICLR 2024 & NeurIPS 2023 WS] An Evaluator LM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically designed for fine-grained evaluation on a customized score rubric, Prometheus is a good alternative for human evaluation and GPT-4 evaluation.
PythonMIT
Stargazers
- 2khaBambou Tree Group
- cem2ran@lenus-ehealth
- cfeng16Ann Arbor, MI, US
- compositediffusion
- davidarAustralia
- fstoStockholm
- Glavin001Remote Software Developer
- id4thomasAI R&D@muhayu Inc.
- joeljangUniversity of Washington
- jshin49NAVER_AI ex-AmazonAlexa ex-@HLTCHKUST
- kabbi159@WRTN-Technologies
- kylezhangwei
- leslyarun
- loretoparisi@Musixmatchdev
- MarkusOdenthalCologne, Germany
- MattYoonKAIST
- mauryalandParis
- MichaelFG
- ozzaneyYonsei university
- PDS99
- pharaouk
- qibincApple AI/ML
- scottsuk0306@kaistAI
- seonghyeonyeKAIST
- SidUMicrosoft
- ssmi153
- thanhtcptitJAIST
- u-brixton
- unverciftciMath & AI Institute
- vasnt
- vonmoltke@twitter
- wisbech
- xg6144Inje University, PhD Program in Computer Engineering
- xuejoy
- yayachenyi
- Zscozer