/bitsandbytes

Accessible large language models via k-bit quantization for PyTorch.

Primary LanguagePythonMIT LicenseMIT

Stargazers