htqin/IR-QLoRA

Issues

• How To Create The Needed Conda Environment?

  #7 opened 5 months ago by EmiyaArcher233
  0

• Does it support LLAMA3-8B-INSTRUCT or Qwen2-7b-instruct？

  #6 opened 6 months ago by LiMa-cas
  0

• QLORA VS PTQ

  #5 opened 6 months ago by LiMa-cas
  0

• RuntimeError: The size of tensor a (2048) must match the size of tensor b (1024) at non-singleton dimension 0

  #4 opened 6 months ago by ClancyCC
  0

• AttributeError: 'IRQLoraLinear4bit' object has no attribute 'base_layer'. Did you mean: 'update_layer'

  #3 opened 10 months ago by xiaoleyang2018
  1

• Code for int4

  #1 opened 10 months ago by hoagy-davis-digges
  3