Asynchronous transcription via asyncio
Opened this issue · 4 comments
Using asyncio will be greatly beneficial in the use case of transcription as most of the time the client waits for a response on a socket when your servers are doing all the great work.
concurrent.futures implementation still works but is not as good for two main reasons:
- The hardware capabilities limit the number of executor workers (or just threads), unlike asyncio's lightweight coroutines
- concurrent.futures module issues blocking operations which can block the event loop in a fully asynchronous environment
Hope for positive feedback on that!
Hey @serozhenka , great feedback!
It's actually on my TODO list for v 1.0.0 to introduce an asyncio client.
I plan to introduce it before v.1.0 so there's a transition period where both asyncio and the threading solution with the _async()
functions can be used.
Sounds great!
Do you have an approximate ETA of when can I expect it to be ready?
aiming for Q4 2024
+1, although I would suggest to use AnyIO so people using Trio can also use the library.