Get quantized models to work
allo- opened this issue · 2 comments
allo- commented
Get the quantized versions of the models to work.
jiangjianping commented
In progress? good news!
allo- commented
No progress yet, but a big item on my wishlist. I just have no idea what's the problem.
The docs say you can just load the quantized model, but it seems not to work so easy and I do not know why.