Issues
- 1
Installation errors -- Cython and Questeval
#104 opened by ashleylew - 0
Issues generating Heavy metrics
#103 opened by SimonvdFliert - 2
- 6
- 2
What _is_ the "checkout"?
#101 opened by thesofakillers - 2
- 14
- 3
Key hyperparameters to reproduce results?
#96 opened by VickiCui - 1
Document API usage of the library
#60 opened by tuetschek - 2
Check for reference data type?
#92 opened by tuetschek - 4
Add PARENT
#14 opened by sebastianGehrmann - 1
L'Ambre metric
#66 opened by sebastianGehrmann - 4
Adding WER/TER/CIDEr
#33 opened by sebastianGehrmann - 2
Add MoverScore
#34 opened by sebastianGehrmann - 0
Support for Multilingual Rouge
#88 opened by ratishsp - 0
- 2
Additional diversity metrics
#24 opened by evanmiltenburg - 0
Support for iBLEU for paraphrasing
#85 opened by ratishsp - 1
Readme for adding metrics
#29 opened by tuetschek - 4
Dataset-specific metrics
#21 opened by evanmiltenburg - 0
- 0
Heavy metrics are not calculated in single-file mode despite using the heavy-metrics option
#76 opened by madaan - 0
- 0
Add verbose mode
#19 opened by evanmiltenburg - 0
- 0
Add a unique versioning key to each metric
#59 opened by sebastianGehrmann - 1
- 0
Change caching to hash of input/output/source instead of filepath based key
#58 opened by sebastianGehrmann - 1
- 0
MATTR metric
#71 opened by ndaheim - 1
MSTTR tests fail with faulty results
#55 opened by ndaheim - 1
MAUVE metric for open-ended text generation
#72 opened by asnota - 4
Tests failing
#65 opened by asnota - 1
Language key typo
#64 opened by asnota - 2
Unit tests do not consider cache
#54 opened by ndaheim - 0
Cannot run example command with example data
#51 opened by lxuechen - 2
Cannot run meteor evaluation
#53 opened by lxuechen - 0
- 0
- 0
- 6
Nubia fails for long texts
#42 opened by tuetschek - 1
Add NUBIA
#36 opened by sebastianGehrmann - 2
Add NIST
#35 opened by sebastianGehrmann - 0
Adding unit tests
#26 opened by madaan - 2
- 0
Type hints
#30 opened by madaan - 4
- 4
Parameter number as descriptive metric
#23 opened by sebastianGehrmann - 8
ValueError in meteor.py
#18 opened by evanmiltenburg - 2
Add License
#15 opened by evanmiltenburg