gomate-community/rageval
Evaluation tools for Retrieval-augmented Generation (RAG) methods.
PythonApache-2.0
Pinned issues
Issues
- 1
Add support for Chinese language evaluation
#91 opened by Wenshansilvia - 1
Dragonball dataset request
#114 opened by girlsending0 - 1
Any pypi package?
#113 opened by zhimin-z - 1
add validate metrics
#30 opened by Wenshansilvia - 3
List all potential test benchmarks
#63 opened by faneshion - 0
Add embedding based ranking benchmark
#83 opened by faneshion - 1
Add ELI5 test benchmark
#62 opened by faneshion - 0
Add auto_benchmak.py in benchmarks
#70 opened by faneshion - 11
add generate metrics
#29 opened by Wenshansilvia - 1
OpenAILLM
#75 opened by bugtig6351 - 1
Define the format of input for all metrics
#46 opened by faneshion - 0
Data quality metrics
#71 opened by faneshion - 1
add rank metrics
#26 opened by Wenshansilvia - 0
- 0
Adding a license
#50 opened by faneshion - 0
- 0
add rewrite metrics
#25 opened by Wenshansilvia - 1
add rewrite task
#9 opened by faneshion - 1
enhance base metric
#45 opened by faneshion - 1
Define output format of evaluate function
#52 opened by Wenshansilvia - 0
Initialize Metrics
#23 opened by Wenshansilvia - 0
add compress metrics
#28 opened by Wenshansilvia - 0
initialize base metric
#24 opened by Wenshansilvia - 1
Initialize Tasks (Benchmarks)
#8 opened by faneshion - 0
add rank task
#10 opened by faneshion - 0
add validate task
#13 opened by faneshion - 0
add generate task
#12 opened by faneshion - 0
add compress task
#11 opened by faneshion - 0
add reranker metrics
#27 opened by Wenshansilvia - 0
Leakage of API Key
#47 opened by bugtig6351 - 0
rewrite base model api
#41 opened by faneshion - 0
re-define the function of init_model in metric
#37 opened by faneshion - 0
Add FakeLLM for test.
#39 opened by faneshion - 0
Initialize the repository
#1 opened by faneshion - 0
Add codecov in repo
#16 opened by faneshion - 0
initialize the benchmarks in the project.
#14 opened by faneshion