thu-ml/low-bit-optimizers

Issues

• How to apply the optimizer to BF16 model?

  #7 opened 8 months ago by Evane5cence
  0

• doesn't work directly with HF transformers trainer.

  #6 opened 8 months ago by winglian
  0

• qlora bfloat16 使用这个优化器出现bug

  #5 opened a year ago by zlh1992
  1

• apply lpmm.optim.AdamW to transformers trainer for multiple gpus training -> error

  #4 opened a year ago by Yeojoon
  5

• 能直接在transformers trainer使用吗？

  #1 opened a year ago by iMountTai
  3