/mixtral-offloading

Run Mixtral-8x7B models in Colab or consumer desktops

Primary LanguagePythonMIT LicenseMIT

Stargazers