Unable to load `quantized` models

Question

Unable to load `quantized` models

Closed this issue 10 months ago · 3 comments

kishorekaruppusamy commented 10 months ago

I am trying to load whisper tiny quantized version ( ggml-tiny-q5_1.bin)
i trying this using jupyter kernal in visual studio code
But when i try to run
model = Model('./models/quantized/ggml-tiny-q5_1.bin', print_progress=False)
Kernal is dying ( unable to load quantized model ) remaining unquantized models are working file seems to be issue in quantized version

Kindly need someone help !!!

Answer 1 · 2024-02-20T03:07:51.000Z

@kishorekaruppusamy, I just pushed a new version 1.2.0 to PYPI that supports the latest version of whisper.cpp.
Quantized models should be working now.

Let me know if you still have any issues ?

Answer 2 · 2024-02-20T04:34:15.000Z

@kishorekaruppusamy, I just pushed a new version 1.2.0 to PYPI that supports the latest version of whisper.cpp. Quantized models should be working now.

Let me know if you still have any issues ?

lets check ...

Answer 3 · 2024-02-20T04:47:38.000Z

@kishorekaruppusamy, I just pushed a new version 1.2.0 to PYPI that supports the latest version of whisper.cpp. Quantized models should be working now.
Let me know if you still have any issues ?

lets check ...

Thanks for the changes !!!, it working now 💥