tensorchord/modelz-llm

feat: Add CLI argument int8 and int4

Opened this issue · 0 comments

To run in quantization. Some packages may need to be installed.