[REQ] fine tune output to exl2 or awq
sozercan opened this issue · 0 comments
sozercan commented
What kind of request is this?
New feature
What is your request or suggestion?
finetune output should support output to EXL2 or AWQ to be used with exllama2 or other backends
Are you willing to submit PRs to contribute to this feature request?
- Yes, I am willing to implement it.