Will it support qlora?
lw3259111 opened this issue · 1 comments
lw3259111 commented
Will it support qlora?
DachengLi1 commented
@lw3259111 We currently have no bandwidth to support qlora, but it would be great if community can help us on this, especially long-context model consumes much more memory.