/web-crawler

Primary LanguagePython

web-crawler

Build Status

Web Crawler Team - What do we do:

web-crawler technology 101

The repository structure consists of two subfolders dedicated to different areaas of web-crawler.

To briefly explain the structure:

  • configurations
  • scripts

Quickstart

Assuming git is installed:

$ git https://github.com/ActoKids/web-crawler.git