This project is intended to learn dagster. It pulls data from the College Football API, and loads it into Google BigQuery
There are two environmental variables needed for this project:
-
An API token from College Football API that you can sign up for here
- I assigned this token to the environment variable
CFB_TOKEN
. IMPORTANT: bearer needs to be prepended to the token. (Ex.CFB_TOKEN=bearer thisismytoken
)
- I assigned this token to the environment variable
-
Google credentials file (JSON) that I point my
GOOGLE_APPLICATION_CREDENTIALS
environment variable to the location of. (Ex.GOOGLE_APPLICATION_CREDENTIALS=C:\Users\Owner\dagster-project\bigquerytest.json