/airflow-scraping

Using Apache Airflow to schedule web scrapers

Primary LanguagePythonMIT LicenseMIT

Airflow Web Scraping

Learn how to implement Apache Airflow in your existing Web Scrapers. This repo is the part of the post Schedule web scrapers with Apache Airflow

Note

Do generate your own airflow configuration files by running airflow initdb instead of using mine.