/apache-beam-pipelines-tuts

This is a learning repository for building Apache Beam powered data engineering pipelines.

Primary LanguagePython

Teams League Dataflow Pipeline

Note: This is a learning repository for building Apache Beam powered data engineering pipelines.

The job read a Json file from Cloud Storage, applies some transformations and write the result to a BigQuery table. The link to the video that explains this use case.

Reference Repo: https://github.com/tosun-si/teams-league-python-standard-beam/