InftyAI/llmlite

Support quantization

kerthcet opened this issue · 0 comments

kerthcet commented
  • int8
  • int4
  • gptq