I would like to help
Opened this issue · 1 comments
Question
Hi, I would like to help with the project. Is there anything that needs to be done?
Currently I found an issue, probably in ONNXRuntime. I will look into it next week.
Here is example of WebGPU Whisper that works with mobile platforms including iPhone and Android: https://github.com/FL33TW00D/whisper-turbo
Current Transformers.js solution have some bugs. It will crash after model loading, page will restart on mobile device. I tried to connect remote debugging to Chrome PC via some ios remote debugging bridge, but it just restarts and I cannot get any logs. Any help how to get logs would be appreciated as I don't have much experience with iOS Safari debugging and I also happen to have Windows PC.
Here is photo from Safari - iPhone, you can see it does not support float32, but only float16. I suspect this is the issue and there are like 3 separate pull requests in ONNX to fix something around float16 support. But I did not have time to merge all current ONNX PRs and build it yet. First I would like to see some log with actual error
This is what I will be working on next weekend.
If there is something else I should look into or help with testing, let me know.
Thank you for great project and great work! :-)