/nba_elt_ingestion

Ingestion Script for NBA ELT Project

Primary LanguagePython

Ingestion Script

Tests ECR Deployment Coverage Status Code Style

Version: 1.13.2

Ingestion Script

The Ingestion Script scrapes from the following sources to extract data and load it to PostgreSQL + S3:

  • basketball-reference
  • DraftKings
  • Reddit Comments
  • Twitter Tweets (RIP Q3 2023)

You'll need to configure your own Database credentials, S3 Bucket, and Reddit API Credentials in order for some of the functionality to work.

Tests

To run tests locally, run make test.

The same Test Suite is ran after every commit on a PR via GitHub Actions.

Project

nba_pipeline_diagram

  1. Links to other Repos providing infrastructure for this Project