/news-api-dag

Created this pipeline which orchestrates a daily ETL pipeline for news data using Python. Utilizing the News API, it fetches top headlines, cleans, and transforms the data. The processed information is then uploaded to AWS S3 using Boto3. The DAG runs daily, with error retries and email notifications configured.

Primary LanguagePython

Watchers

No one’s watching this repository yet.