/yelp-beam

Apache Beam Data Pipeline that runs with Google Dataflow runner

Primary LanguagePython

Yelp Beam (Sky Beam)

Command to Trigger

python -m sky_beam.main
--runner DataflowRunner
--folder_name
--temp_location
--project
--region

Stack

  • technologies used:
    • Python
    • Apache Beam
    • Google Cloud Dataflow
    • Google Cloud BigQuery
    • Google Cloud Storage
    • GitHub Actions (black formatter, isort, flake8, GitGuardian community action)

Accompanying Blog post located here