/qmoe

Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".

Primary LanguagePythonApache License 2.0Apache-2.0

Stargazers