Aleph-Alpha/magma

Update to latest version of transformers

sdtblck opened this issue · 1 comments

sdtblck commented

Will require changes to GPTJ

CoEich commented

TODO:

  • Compare gpt-j model outputs of of the different transformer versions
  • Ensure backwards compatibility, i.e being able to load old checkpoints