spcl/QuaRot

Code for QuaRot, an end-to-end 4-bit inference of large language models.

PythonApache-2.0