aredden/flux-fp8-api

Docker image support.

ShivamB25 opened this issue · 5 comments

please. i can also try making a image with nvida cuda as base layer

I have a docker setup working with this, and I have optimized API changes as well, I'm planning to make a large PR soon once I fix all the LoRA issues.

Ah cool! @0xtempest If it's a very large PR, could it be done in pieces? I would like to be able to test each change individually since for a very large PR it can be tough to figure out what is doing what. Also yeah, docker should be relatively simple to set up since you can just use a pytorch container and install the requirements.

Yeah I can break it down in smaller PR's, probably will be early next week as there's a lot to clean up

@0xtempest Could you please keep your fork (please add updates). and i would love to test around

@0xtempest possible ? i would also like to try helping with lora's issues