t0n/dockerized-django-selenium-cralwer
Configure sites to be crawled via simple django app (proxied with nginx, backed by postgres) and run tasks via celery that will parse websites with selenium/phantomjs. All parts in their own docker containers.
Python