embeddings-benchmark/mteb

Issues

• Finalizing MMTEB

  #784 opened 17 days ago by KennethEnevoldsen
  6

• Integrate BIRCO

  #818 opened 14 days ago by Muennighoff
  12

• Integrate RAR-b

  #859 opened 7 days ago by Muennighoff
  0

• About Evaluation Scripts

  #857 opened 8 days ago by twadada
  1

• Consolidate "convert_to_fast" methods in AbsTaskClusteringFast

  #834 opened 11 days ago by isaac-chung
  12

• Refresh after submitting model issues

  #774 opened 18 days ago by raghavlite
  3

• Paper segment: Score aggregation

  #839 opened 11 days ago by KennethEnevoldsen
  2

• Paper segment: Task selection

  #837 opened 11 days ago by KennethEnevoldsen
  4

• Versioning for AbsTasks

  #851 opened 9 days ago by x-tabdeveloping
  1

• Use stratification in multilabel tasks.

  #850 opened 9 days ago by x-tabdeveloping
  2

• Paper: Multilevel clustering and Multi clf

  #849 opened 9 days ago by x-tabdeveloping
  2

• Convert PLSC to Fast

  #852 opened 9 days ago by x-tabdeveloping
  0

• running baseline models

  #840 opened 11 days ago by KennethEnevoldsen
  6

• Problems with mteb_meta for german evaluation

  #847 opened 10 days ago by achibb
  3

• Add system info to result output

  #848 opened 9 days ago by KennethEnevoldsen
  0

• Disappearing dataset repos

  #843 opened 10 days ago by isaac-chung
  1

• Integrate JMTEB

  #749 opened 22 days ago by Muennighoff
  3

• Add support for saving embeddings in evals

  #824 opened 13 days ago by dhruvbpai
  4

• Paper segment: Speeding up MTEB (English) + co2 impact

  #838 opened 11 days ago by KennethEnevoldsen
  2

• Paper segment: Comparing scores of Clustering to ClusteringFast

  #835 opened 11 days ago by KennethEnevoldsen
  2

• Paper segment: Speeding up retrieval

  #836 opened 11 days ago by KennethEnevoldsen
  0

• Convert BlurbsClusteringS2S to fast

  #828 opened 11 days ago by imenelydiaker
  0

• Convert MLSUM to Fast

  #798 opened 15 days ago by jankounchained
  2

• Combine MIRACLRerankingEvaluator and RerankingEvaluator into one

  #829 opened 12 days ago by KennethEnevoldsen
  0

• Inconsistencies in the naming of some tasks fast clustering versions

  #823 opened 13 days ago by imenelydiaker
  9

• To speed up MindSmallReranking

  #738 opened 14 days ago by memray
  4

• Convert HALClusteringS2S to Fast

  #814 opened 14 days ago by AlexeyVatolin
  0

• Convert AlloProfClustering to Fast

  #816 opened 14 days ago by AlexeyVatolin
  0

• Convert BigPatent to Fast

  #801 opened 14 days ago by AlexeyVatolin
  4

• [BUG] MalteseNewsClassification fails with KeyError

  #810 opened 14 days ago by dokato
  1

• Question about Adding Datasets

  #802 opened 15 days ago by Ruqyai
  3

• Datasets not available on HF

  #797 opened 15 days ago by jankounchained
  0

• Convert MasakhaNews to Fast

  #800 opened 15 days ago by AlexeyVatolin
  3

• Fix : Error [test_all_metadata_is_filled ]

  #762 opened 16 days ago by Ruqyai
  2

• Carbon emission tracker raises error

  #790 opened 17 days ago by imenelydiaker
  0

• Convert Polish Clustering tasks to Fast

  #786 opened 17 days ago by isaac-chung
  0

• Only Spanish is covered in FloresClustering

  #782 opened 17 days ago by isaac-chung
  9

• update automatic metadata construction

  #783 opened 17 days ago by KennethEnevoldsen
  0

• Add Similarity Metric Used to leaderboard

  #766 opened 19 days ago by aminst
  6

• Convert TwentyNewsgroups to fast clustering

  #771 opened 18 days ago by isaac-chung
  0

• Convert StackExchange Issue to Fast

  #739 opened 18 days ago by shreeya-dhakal
  0

• Adding Public Health QA dataset

  #741 opened 18 days ago by xhluca
  3

• Convert SIB200Classification to SIB200Clustering

  #732 opened 19 days ago by KennethEnevoldsen
  2

• Convert ThuNews and CLS to Fast

  #755 opened 19 days ago by isaac-chung
  0

• Extend pair classification

  #753 opened 22 days ago by x-tabdeveloping
  3

• Convert WikiClusteringP2P to Fast

  #742 opened 22 days ago by isaac-chung
  0

• Running Models

  #746 opened 22 days ago by y12uc231
  2

• MindSmallReranking dataset errors out due to download/parsing error?

  #747 opened 22 days ago by w601sxs
  6

• Suggestion for clustering dataset (legislative texts)

  #744 opened 22 days ago by rbroc
  1

• stratified_subsampling not handling multilingual datasets yet

  #743 opened 23 days ago by isaac-chung
  2