allenai/catwalk

Issues

• Update tango requirement to use latest

  #145 opened a year ago by AkshitaB
  0

• Rename `Task` -> `Dataset` and `Model` -> `ModelWrapper`

  #118 opened 2 years ago by dirkgr
  0

• run OPT

  #29 opened 2 years ago by dirkgr
  2

• Request: Either remove `short_name_for_model_object` or allow for full name registering of models

  #116 opened 2 years ago by kyleclo
  1

• trainable_copy might need override_weights_file

  #68 opened 2 years ago by IanMagnusson
  1

• Fine-tune a model

  #48 opened 2 years ago by dirkgr
  1

• cached_transformers.get() load_weights arg is not implemented.

  #63 opened 2 years ago by IanMagnusson
  1

• Problem with the WandB workspace

  #36 opened 2 years ago by dirkgr
  2

• Problem with the Beaker workspace

  #35 opened 2 years ago by dirkgr
  0

• add `greedy_until` requests to GPT

  #25 opened 2 years ago by dirkgr
  1

• Switch mypy_extensions.KwArg to typing.Protocol

  #33 opened 2 years ago by IanMagnusson
  0

• Adding models/methods/datasets

  #27 opened 2 years ago by dirkgr
  0

• Min et al. variant of in-context learning

  #26 opened 2 years ago by dirkgr
  0

• Add a way to train a model before evaluating it

  #4 opened 3 years ago by dirkgr
  0

• Add Tasks

  #8 opened 3 years ago by dirkgr
  1

• Slight differences in scores between EAI and Catwalk

  #16 opened 3 years ago by dirkgr
  2

• Add more models

  #21 opened 3 years ago by dirkgr
  0

• Write the first model that uses prompting

  #3 opened 3 years ago by dirkgr
  0

• implement piqa on GPT2

  #13 opened 3 years ago by dirkgr
  0

• Import EAI tasks

  #9 opened 3 years ago by ibeltagy
  3

• perplexity needs to pass down the number of tokens, so we can match official numbers

  #12 opened 3 years ago by dirkgr
  0

• Import all the CrossFit tasks

  #7 opened 3 years ago by dirkgr
  0

• Adapter tuning

  #6 opened 3 years ago by dirkgr
  0

• Prompt tuning

  #5 opened 3 years ago by dirkgr
  0