ali-vilab/Ranni

Quantized Model Usage?

Opened this issue · 1 comments

GalenMarek14 commented

Is there a way to use quantized models? The current version is really out of reach for most people with consumer-grade GPUs.

Also, will you train / release models for SD1.5 and SDXL?

Thanks!

thss15fyt commented

Thanks for your interest.

  1. Currently we do not have plan to develop quantized model of Ranni. But for the LLM part, it might be easy to incorporate quantization tools from community for the LLama2 model used here.
  2. For 1.5/SDXL, refer to #4
  • ❤️1