aio-libs/aiohttp-demos

Implement demo of idiomatic crawler using aiohttp client

jettify opened this issue · 6 comments

jettify commented

Lots of people using aiohttp client to crawl internet [1], I think to encourage good practices and idiomatic approach it is good idea to have specific demo for this purposes. Good starting point is [2]

[1] https://medium.com/@cgarciae/making-an-infinite-number-of-requests-with-python-aiohttp-pypeln-3a552b97dc95
[2] http://www.aosabook.org/en/500L/a-web-crawler-with-asyncio-coroutines.html

K0Te commented

I'd like to work on this issue, it seems to be an interesting task.

  • 👍3
webknjaz commented

Go ahead :)

gyermolenko commented

hey @K0Te
No pressure, but is there any progress for this task?

K0Te commented

Hi @gyermolenko,

Sorry for delay - I'll try to submit PR soon.

gyermolenko commented

@K0Te 👌
no hurry , just wanted to know issue status