Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".
Primary LanguagePythonApache License 2.0Apache-2.0