obss/jury

Issues

• ValueError: unmarshallable object

  #138 opened 5 months ago by AI-14
  5

• Meteor for multiple languages

  #135 opened a year ago by salvadora
  1

• Drop Python 3.7 Support

  #131 opened a year ago by devrimcavusoglu
  0

• [BUG] requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: https://huggingface.co/api/models/wmt21-cometinho-da/revision/main

  #127 opened a year ago by devrimcavusoglu
  3

• ZeroDivisionError: division by zero in AccuracyForLanguageGeneration._compute_single_pred_single_ref

  #122 opened 2 years ago by NISH1001
  3

• [BUG] AttributeError: 'DownloadConfig' object has no attribute 'storage_options'

  #125 opened 2 years ago by devrimcavusoglu
  5

• Fix `sklearn` dependency

  #120 opened 2 years ago by devrimcavusoglu
  0

• BLEURT is failing to produce results

  #119 opened 2 years ago by Santhanreddy71
  4

• Move infrastructure to new `evaluate` package (from `datasets`)

  #115 opened 2 years ago by devrimcavusoglu
  0

• ModuleNotFoundError: No module named 'validators'

  #111 opened 2 years ago by devrimcavusoglu
  0

• Refactor docstrings, typo-check, review imports

  #106 opened 3 years ago by devrimcavusoglu
  0

• Add COMET

  #99 opened 3 years ago by devrimcavusoglu
  0

• Prism support for use_cuda option

  #94 opened 3 years ago by devrimcavusoglu
  0

• Add CHRF

  #100 opened 3 years ago by devrimcavusoglu
  0

• Add TER

  #102 opened 3 years ago by devrimcavusoglu
  0

• Add WER

  #101 opened 3 years ago by devrimcavusoglu
  0

• Add license information for BLEURT and Prism

  #93 opened 3 years ago by devrimcavusoglu
  0

• New Metric: Add BARTScore

  #71 opened 3 years ago by devrimcavusoglu
  0

• New source for Prism model

  #91 opened 3 years ago by devrimcavusoglu
  0

• New Metric: CER

  #77 opened 3 years ago by devrimcavusoglu
  0

• Nltk version upgrade for >=3.6.6

  #87 opened 3 years ago by devrimcavusoglu
  0

• Refactor all metrics to use dl_manager internally

  #83 opened 3 years ago by devrimcavusoglu
  0

• Add support for BERTScore to 0.3.11

  #70 opened 3 years ago by devrimcavusoglu
  1

• New Metric: Prism

  #75 opened 3 years ago by devrimcavusoglu
  0

• Add citation for the project (zenodo)

  #80 opened 3 years ago by devrimcavusoglu
  0

• New metric: Add BLEURT

  #76 opened 3 years ago by devrimcavusoglu
  0

• BLEU metric calculates wrong results for single hypothesis single reference pairs.

  #72 opened 3 years ago by Sophylax
  0

• Add support for custom tokenizer for BLEU

  #73 opened 3 years ago by devrimcavusoglu
  0

• load_metric by path (relative/absolute)

  #68 opened 3 years ago by devrimcavusoglu
  0

• Facing datasets error

  #66 opened 3 years ago by amit0623
  8

• Discard empty corpus before computation

  #64 opened 3 years ago by devrimcavusoglu
  0

• BLEU: ndarray reshape error

  #62 opened 3 years ago by Axe--
  4

• Understanding BLEU Score ('bleu_n')

  #58 opened 3 years ago by Axe--
  4

• Upgrade nltk>=3.6.4

  #60 opened 3 years ago by devrimcavusoglu
  0

• Read support from a folder

  #44 opened 3 years ago by devrimcavusoglu
  0

• Computing BLEU more than once

  #56 opened 3 years ago by Axe--
  4

• Metrics for different tasks

  #52 opened 3 years ago by devrimcavusoglu
  0

• Adopt arrow implementation from datasets

  #48 opened 3 years ago by devrimcavusoglu
  0

• Implementing fixtures for test cases.

  #38 opened 3 years ago by devrimcavusoglu
  0

• Add multiple ref handle for squad

  #45 opened 3 years ago by devrimcavusoglu
  0

• CLI Implementation

  #14 opened 3 years ago by devrimcavusoglu
  5

• Bug: Metric object and string cannot be used together in input.

  #37 opened 3 years ago by devrimcavusoglu
  1

• demo notebook

  #7 opened 3 years ago by fcakyon
  2

• Add QA metrics (squad) to the current system.

  #5 opened 3 years ago by devrimcavusoglu
  0

• Imrpove metric definitions

  #31 opened 3 years ago by devrimcavusoglu
  0

• Add reduce_fn parameter

  #18 opened 3 years ago by devrimcavusoglu
  1

• README.md update elaborating usage.

  #19 opened 3 years ago by devrimcavusoglu
  1

• Multiple predictions and multiple references

  #13 opened 3 years ago by devrimcavusoglu
  0

• usage in readme

  #9 opened 3 years ago by fcakyon
  0