4-bit
Closed this issue · 3 comments
okaneyo commented
More compression
filipstrand commented
@okaneyo Great suggestion! Have not really investigated this myself yet, but looking around this seems really promising. For example, it looks like https://github.com/argmaxinc/DiffusionKit have recently added 4bit support for Flux. I have added this to the todo list!
filipstrand commented
@okaneyo This feature has now been added to the project. Let me know if something does not work as expected!
n0kovo commented
More compression