/whittle

Python library to compress LitGPT models for resource efficient inference.

Primary LanguagePythonApache License 2.0Apache-2.0

Stargazers