A very quick benchmark sensitive to quantization of advanced LLMs
Primary LanguagePythonGNU General Public License v2.0GPL-2.0
A very quick benchmark sensitive to quantization of advanced LLMs such as Llama-3-8b.