Allow pruning script to prune with float32 instead if float16
ProGamerGov opened this issue · 4 comments
Currently your pruning script reduce the model size to 2GB at the cost of converting it to half precision. You should add an option to keep it full precision.
I would also like this!
From my experiments, there's no difference in quality from 2GB to 4GB. If I prune a normal SD model from SAI/Compvis/Runyway, they produce the same output. Are you finding otherwise?
Looks like you issued a PR for this so no reason not to allow it if you want.
@victorchall In my experience, the overall image generally remains the same when using half precision, however some key details will differ. With half precision, these differences generally result in worse outputs than with the full precision version.
It can be tricky notice at first though, but half precision has issues with output quality.