How can we change the quantization settings?
Opened this issue · 0 comments
kentaroy47 commented
Nice implementation!
I was wondering if we can experiment with different quantization settings (e.g. 6bit).
Thanks!
Opened this issue · 0 comments
Nice implementation!
I was wondering if we can experiment with different quantization settings (e.g. 6bit).
Thanks!