/quantizeHFmodel

Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.

Primary LanguagePythonApache License 2.0Apache-2.0

Stargazers