/BenefitObserver

Primary LanguagePythonMIT LicenseMIT

Async web crawler using queue system

To store web data from scrapy module via celery and rabbitmq as async

image

Stack

  • Django
  • Celery
  • Rabbitmq
  • Scrapy