Yale-LILY/SummEval

Issues

• Help Reproducing the Results

  #13 opened 3 years ago by PierreColombo
  7

• ROUGE-WE relies on a download link that no longer works

  #48 opened 8 months ago by alichte
  2

• summa_qa is not working

  #49 opened 8 months ago by nilanjansircar80
  0

• Can not reproduce the rouge score.

  #44 opened a year ago by SefaZeng
  0

• which 16 models to generate the human annotation results

  #43 opened a year ago by dzf0023
  0

• Cost spent on human annotation

  #42 opened a year ago by LiyingCheng95
  0

• Value Error in Bert_Score_Metric

  #21 opened 2 years ago by StephenMal
  2

• Identifying individual annotators

  #41 opened a year ago by eryk-mazus
  2

• Unable to import the package

  #39 opened 2 years ago by 29riyasaxena
  1

• Unittests fail

  #40 opened 2 years ago by oriern
  2

• Is the BertScore metric used with idf weighted averaging or not

  #3 opened 4 years ago by La-SilverLand
  4

• Error running Meteor metric

  #38 opened 2 years ago by JeetRoy97
  0

• SupertMetric: sentence_transformers module not found

  #36 opened 2 years ago by ankitk2109
  2

• SummaQAMetric: NameError name 'stderr' is not defined

  #37 opened 2 years ago by ankitk2109
  1

• sys.exit import missing in supert_metric.py

  #19 opened 2 years ago by zakhan4
  8

• corpus_chrf() got an unexpected keyword argument 'order'

  #24 opened 2 years ago by martin6336
  2

• Fix the description at pypi.org

  #30 opened 2 years ago by SubhamBurnwal
  1

• error while running setup on windows

  #34 opened 2 years ago by shankyemcee
  1

• Can't install the package

  #35 opened 2 years ago by stefcon
  0

• Says Illegal instruction for running command line argument

  #33 opened 2 years ago by shankyemcee
  0

• Errors after installing via pip and fixes

  #32 opened 2 years ago by ankitk2109
  0

• How can I get "model_annotations.aligned.scored.jsonl"

  #18 opened 3 years ago by vincent1rookie
  1

• Error during installation

  #28 opened 3 years ago by darioTecchia
  3

• ValueError: Found array with 0 sample(s) (shape=(0, 1024)) while a minimum of 1 is required by check_pairwise_arrays.

  #31 opened 2 years ago by paluchasz
  0

• PR to add new metric results

  #27 opened 3 years ago by PierreColombo
  1

• mover metric

  #25 opened 3 years ago by martin6336
  0

• Unable to install

  #20 opened 3 years ago by amanyakhyar
  2

• Installing backend dependencies ... error

  #11 opened 3 years ago by PPGHPP
  10

• Code to Reproduce System-Level Metrics

  #17 opened 3 years ago by mingkaid
  13

• Is it possible to release a table of all paired data and scoring results?

  #9 opened 3 years ago by johntzwei
  5

• MeteorMetric.evaluate_batch(hyps, refs) fails with error: BrokenPipeError: [Errno 32] Broken pipe

  #15 opened 3 years ago by zakhan4
  2

• Unable to install dependency (wmd)

  #14 opened 3 years ago by anjalibshah
  3

• Data pairing is giving issues

  #4 opened 4 years ago by artidoro
  3

• Error with ROUGE

  #12 opened 3 years ago by PierreColombo
  1

• Version Conflict error

  #10 opened 3 years ago by Rumi4
  4

• Punctuation not consistent for M19 (Text Summarization with Pretrained Encoders)

  #7 opened 4 years ago by artidoro
  3

• Data format questions

  #8 opened 4 years ago by danieldeutsch
  2

• The example doesn't work.

  #6 opened 4 years ago by dominik-schwabe
  2

• Missing import

  #5 opened 4 years ago by artidoro
  1

• [Data] M0 aligned document count is much less than the orignal CNN/DM documents

  #2 opened 4 years ago by La-SilverLand
  3

• M16 confusion in matching outputs to models

  #1 opened 4 years ago by shahbazsyed
  2