IBM/unitxt

Issues

• get_from_catalog does not return a fresh copy of the catalog object

  #1364 opened a month ago by yoavkatz
  1

• Need a way to rename and deprecate artifacts

  #1341 opened a month ago by yoavkatz
  0

• Simple API to run load and evaluate datasets based on tasks and input data

  #1327 opened a month ago by yoavkatz
  4

• Several processors are added twice to the catalog

  #1331 opened a month ago by martinscooper
  0

• Dcoumentation bad formatting

  #1332 opened a month ago by martinscooper
  0

• Add num_instances to scores

  #1260 opened 2 months ago by yoavkatz
  1

• Issue when installing unitxt on MacOS

  #1287 opened 2 months ago by pawelknes
  1

• Fix LLMAsJudge validation with OpenAIInferenceEngine

  #1293 opened 2 months ago by lilacheden
  0

• Simplify rag-eval templates and tasks preparation

  #1291 opened 2 months ago by lilacheden
  0

• Allow dynamically created tasks in llm_as_judge

  #1292 opened 2 months ago by lilacheden
  0

• No documentation for Serializers

  #1283 opened 2 months ago by yoavkatz
  0

• Add to all inference engines minimal dummy mode for tests and preparation actions

  #1196 opened 2 months ago by elronbandel
  0

• Target of demo is missing when using produce()

  #1265 opened 2 months ago by marukaz
  0

• No documentation for inference engines

  #1235 opened 3 months ago by elronbandel
  0

• WMLInferenceEngine concurrency_limit

  #1215 opened 3 months ago by allyssonf
  2

• setting score_prefix for metric results in exception in group scores

  #1214 opened 3 months ago by ellarabi
  1

• Current Formats do support different target_prefix in demos

  #1006 opened 3 months ago by yoavkatz
  3

• Exponential time complexity when confidence interval calculation is enabled

  #1008 opened 3 months ago by jezekra1
  14

• Different rouge scores in 1.11.1 and main

  #1078 opened 3 months ago by yoavkatz
  21

• Add warning when metrics scores overwrite each other.

  #1069 opened 3 months ago by yoavkatz
  1

• More meaningful error message when catalog consistency fails

  #1106 opened 3 months ago by yoavkatz
  1

• Add unified decorator for all warnings

  #1208 opened 3 months ago by MikolajCharchut
  0

• Slow performance due copying of instances

  #987 opened 3 months ago by yoavkatz
  5

• Enable separation to different parameters in task_data.source

  #1202 opened 3 months ago by Aya168
  4

• Demo pool is returned as a stream and goes through demo verbalization.

  #1210 opened 3 months ago by yoavkatz
  0

• Raise-warning experimental decorator

  #1199 opened 3 months ago by MikolajCharchut
  0

• DeprecatedField triggers a warning when using a class with it even when the user did not use the deprecated field

  #1135 opened 4 months ago by elronbandel
  10

• Align Bold and Attaq card with a documented catalog task

  #1165 opened 4 months ago by elronbandel
  0

• HFSystemFormat Exception

  #1144 opened 4 months ago by allyssonf
  0

• fixing the typo: "def text_context_correctness(self):" -> "def test_context_correctness(self):" blows the test

  #1136 opened 4 months ago by dafnapension
  3

• Checking types of initialization values passed to artifacts

  #1133 opened 4 months ago by yoavkatz
  0

• Remove all if __name__ == "__main__": from prepare/*

  #1132 opened 4 months ago by elronbandel
  0

• Create Rename and deprecate RenameFields

  #1125 opened 4 months ago by yoavkatz
  0

• Create OptionSelectingInferenceEngine

  #1128 opened 4 months ago by elronbandel
  0

• Create a documentation page comparing unitxt and other related platforms

  #1127 opened 4 months ago by elronbandel
  0

• A petty issue with MetricsEnsemble's global score, that surfaces a general problem

  #1059 opened 4 months ago by dafnapension
  2

• Documentation: Broken link to llama blog in adding_format.rst

  #1114 opened 4 months ago by andersonm-ibm
  0

• Remove StandardRecipe from main examples in documentation

  #1108 opened 4 months ago by yoavkatz
  0

• Add RAG end-to-end task and metrics to unitxt + clapNQ dataset for RAG end-to-end task

  #1048 opened 4 months ago by benjaminsznajder
  0

• BUG - dataset loader

  #1073 opened 4 months ago by eliyahabba
  3

• Repetitive basic instruction in few shot

  #1075 opened 4 months ago by eliyahabba
  2

• Add a reduced version of ClapNQ

  #1051 opened 5 months ago by benjaminsznajder
  0

• Catalog preparation takes over 30 minutes which is too long

  #1042 opened 5 months ago by yoavkatz
  0

• consolidate the 2 "data_classification_policy" fields in the recipe

  #1040 opened 5 months ago by OfirArviv
  0

• Allow selection of demonstrations in ICL based on similarity to current instance

  #1028 opened 5 months ago by yoavkatz
  0

• Unitxt site can't be reached

  #1017 opened 5 months ago by marukaz
  3

• MMLU Template Instruction Inconsistency

  #990 opened 5 months ago by RonaldBXu
  1

• Issue with Backward Compatibility in Version Updates

  #999 opened 5 months ago by eliyahabba
  1

• Better support for chat format

  #989 opened 5 months ago by yoavkatz
  0

• Add speed ups guide

  #986 opened 5 months ago by elronbandel
  1