Adriankhl/godot-llm

godot-llm enhancements

fire opened this issue · 5 comments

fire commented

We also made something based on ggml. https://github.com/V-Sekai/v-sekai.whisper We were able to add opencl acceleration and build for multiple platforms.

Thanks to @Ughuuu

Do you want us to send help?

Ughuuu commented

Hey, @fire , you commented! Also send him if possible to our discord or something, might make communication easier.

fire commented

Here's our discord. https://discord.gg/H3s3PD49XC

  • 👍2
Ughuuu commented

What I did for whisper addon is basically github action files, mac signing, loading models, etc. not much and could be reused maybe.

Adriankhl commented

Just joined the disord. Currently, this plugin uses vulkan as the backend, so in principle this should be relatively easy to port it for Mac. However, I don't have a Mac myself and I have no knowledge about Mac, it would already be very helpful someone could offer help for mac build and signing.

I am also planning to work on github action build automation once I added more essential features to the plugin.

  • 👍1
fire commented

Awesome about the vulkan integration. We did metal integration once, maybe it'll be easy this time too.

  • 👍2