/llama-int8

Quantized inference code for LLaMA models

Primary LanguagePythonGNU General Public License v3.0GPL-3.0

Watchers