/BigQuery-CDC

BigQuery Change Data Capture (CDC)

Primary LanguagePythonApache License 2.0Apache-2.0

BigQuery-CDC

This repo contains an example of how to stream UPSERTs natively into BigQuery.

BigQuery change data capture (CDC) updates your BigQuery tables by processing and applying streamed updates to existing data. This synchronization is accomplished through upsert and delete row operations, which are streamed in real-time by the BigQuery Storage Write API.

Documentation on how to use the Storage Write API can be found HERE.

The blog post which provides context into BigQuery CDC and streaming upserts can be found HERE.

Please refer and copy the files from the cdc-example folder.