josStorer/RWKV-Runner

Convert models to GGUF via llama.cpp

Opened this issue · 0 comments

bennmann commented

Please add llama.cpp quant functionality (convert to Q5_K_L, Q2_XS, etc) to Convert precision section:

image