Contributing models / making it easier to load from a local directory
dcolish opened this issue · 3 comments
I ran an experiment on prompthero/openjourney-v2 to compile it for coreml. I also put that on huggingface to make it work with the Diffusers App. It would be really nice to make this process easier as well as let users point to their own local models rather than downloading from HG. Would you like a more robust contribution for this feature?
For reference:
- I used https://github.com/apple/ml-stable-diffusion to convert the models. Probably worth a script to make the process easier.
- https://huggingface.co/dcolish/coreml-openjourney-v2 is the model repo.
- I edited ModelInfo class to add it. Its pretty straightforward.
Completely agree, this should be the focus of an upcoming release! In my opinion, making models from the Hub discoverable from the app should be our top priority, as most users could benefit from such a feature. But if you'd like to contribute a local loader we'd be more than happy to review and/or help you bring it home! I'm also exploring ideas to make conversion much easier :)
You don't happen to have a discord... I have a few things in flight I wanted to chat about because I'm new to swift development and I'm not entirely sure they're ready to share broadly yet.
Also - i wanted to verify I'm doing the dev right. xcode is slightly odd to set up
We sure do! https://discord.gg/a9XpacAw
After you are in you can visit the #role-assignment channel and select the Diffusers topic, and then a few channels about diffusion will show up for you. You are welcome to post in, for example, #dev-discussions, or I'm @pcuenq there.