/ColabMixtral

Welcome to the Mixtral 8x7B offloading demo repository! This project aims to demonstrate the seamless execution of Mixtral-8x7B models on Colab or consumer desktops.

Primary LanguagePythonMIT LicenseMIT

Stargazers