/crawlab

Distributed web crawler admin platform for spiders management regardless of languages and frameworks.