/aiohttp_spider

An example of web spider using aiohttp

Primary LanguagePython

aiohttp_spider

This is an example of web-spider with concurrent workers using aiohttp session client and asyncio event loop. Also there is an example of concurrent file downloader.

Web-spider example requires:

  1. python 3.5;
  2. aiohttp;
  3. lxml;
  4. beautifulSoup (4);

Downloader example requires:

  1. python 3.5;
  2. aiohttp;