CharlesMod/quantizeHFmodel
Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.
PythonApache-2.0
Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.
PythonApache-2.0