/Huiyan

Primary LanguagePython

Async Huiyan Crawler

async crawler

Instruction:

  • configure all the params in configs/static_vars
  • run start_Request.py
  • a parameter in spider/schedule: save = True/False. save poi in geojson format while True and not while False.

Concat:

Feel free to email me: kingsleyl0107@gmail.com