real-time processing

Question

real-time processing

daidi opened this issue a year ago · 5 comments

I aspire for my program to acquire the real-time processing outcomes while in operation, enabling the transmission of notifications to the foreground about the ongoing data manipulation through the means of something like events emit.

Answer 1 · 2023-08-21T06:37:28.000Z

Is this feasible?

Answer 2 · 2023-08-21T06:40:22.000Z

If you just want to show a status bar to the user, you'd likely be fine with set_progress_callback. If on the other hand you want to show the actual output to the user in real time, there's nothing really designed for it but you could probably hack something together with set_filter_logits_callback

Answer 3 · 2023-08-21T06:42:05.000Z

thank you for your kind reply

Answer 4 · 2023-08-21T06:43:08.000Z

maybe it could potentially be a feature that can be implemented natively in the future.

Answer 5 · 2023-08-21T06:45:10.000Z

I doubt that would be done, as the architecture of Whisper itself was never really designed for such a thing, as Whisper always pads audio segments to at least 30 seconds, making it relatively inefficient to do real time transcription.