Limit the parallelism degree

[baruchiro]

I think the amount of parallel downloads should be in the amount of CPU cores, or something similar.

Because there is a limit of how we can download in any moment, and if this moment shared with a lot of downloads, it will take a long time for the first download to finish.

So we need a queue, maybe python can handle this out of the box, and if not, we want to decide on the parallelism degree.

[the-blank-x]

We can use asyncio.Semaphore to block when there are too many parallel downloads at once.

[baruchiro]

Just a question, why not using asyncio.Queue as this example?

[the-blank-x]

Ah yes, asyncio.Queue is better for your usecase.

[baruchiro]

Thanks for your response. Do you want to implement this?

I don't familiar with the asyncio feature, and I think we not in ideal case here, since we use an existing Event Loop from telethon, am I right?

[the-blank-x]

Sorry for being late, but yes, I'd like to implement this, and we are using the same event loop that telethon is using.