xhedit/quantkit

add HQQ support

Closed this issue · 2 comments

Love the repo ❤️

I want to create a good first issue if is possible to add HQQ quants

Google Colab AutoHQQ by macadeliccc

I was learning HQQ but I'm learning curve also

Okay, I pushed an updated version to pypi with HQQ support. Update with pip install llm-quantkit -U and give it a whirl.

Thanks @xhedit, very cool I would test it