huggingface/transformers.js

I would like to help

Opened this issue · 1 comments

Question

Hi, I would like to help with the project. Is there anything that needs to be done?

Currently I found an issue, probably in ONNXRuntime. I will look into it next week.

Here is example of WebGPU Whisper that works with mobile platforms including iPhone and Android: https://github.com/FL33TW00D/whisper-turbo

Current Transformers.js solution have some bugs. It will crash after model loading, page will restart on mobile device. I tried to connect remote debugging to Chrome PC via some ios remote debugging bridge, but it just restarts and I cannot get any logs. Any help how to get logs would be appreciated as I don't have much experience with iOS Safari debugging and I also happen to have Windows PC.

Here is photo from Safari - iPhone, you can see it does not support float32, but only float16. I suspect this is the issue and there are like 3 separate pull requests in ONNX to fix something around float16 support. But I did not have time to merge all current ONNX PRs and build it yet. First I would like to see some log with actual error
webgpu

This is what I will be working on next weekend.

If there is something else I should look into or help with testing, let me know.

Thank you for great project and great work! :-)

but it just restarts and I cannot get any logs.

Check the 'preserve log' box:
Screenshot 2024-10-14 at 21 37 15