How can we change the quantization settings?

Question

Opened this issue 3 years ago · 0 comments

Nice implementation!

I was wondering if we can experiment with different quantization settings (e.g. 6bit).
Thanks!