rocketechgroup

airflow_k8_dbt_demo

Demo code on how to run dbt on cloud composer k8 executor

airglue

Glue Airflow Operators together without writing Python

cloud-run-gpg-decryptor

A gpg decryptor service runs on cloud run to decrypt files from GCS as they land via the event triggered to PubSub

cloud-run-pubsub-consumer

PubSub Consumer using Cloud Run jobs (batch schedule)

dbt-container-for-bigquery

A template DBT project for BigQuery on Google Cloud

dbt-on-cloud-run

Execute DBT core on cloud run

direct-pubsub-bq-stream

Example code using the PubSub BigQuery subscription to ingest data into BigQuery

kafka-pubsub-bigquery-example

An example showing how to relay messages from Kafka to BigQuery via PubSub

langchain_bigquery_vector

A pretty useful use case with Langchain using BigQuery vector search

spark-on-dataproc-via-docker

Run spark on Dataproc using a custom docker runtime

rocketechgroup/langchain_bigquery_vector

A pretty useful use case with Langchain using BigQuery vector search

rocketechgroup/dbt-on-cloud-run

Execute DBT core on cloud run

rocketechgroup/cloud-run-pubsub-consumer

PubSub Consumer using Cloud Run jobs (batch schedule)

rocketechgroup/direct-pubsub-bq-stream

Example code using the PubSub BigQuery subscription to ingest data into BigQuery

rocketechgroup/spark-on-dataproc-via-docker

Run spark on Dataproc using a custom docker runtime

rocketechgroup/cloud-run-gpg-decryptor

A gpg decryptor service runs on cloud run to decrypt files from GCS as they land via the event triggered to PubSub

rocketechgroup/kafka-pubsub-bigquery-example

An example showing how to relay messages from Kafka to BigQuery via PubSub

rocketechgroup/bigframes

Testing out bigframes

rocketechgroup/bigquery-backup-snapshot-automation

Automate the backup process using BigQuery Snapshot

rocketechgroup/dataplex_auto_dq

rocketechgroup/mysql-to-bq-datastream

rocketechgroup/bigquery-to-datastore-via-beam

rocketechgroup/cloud-datastore-ttl

Sample scripts to test out the TTL feature of Cloud Datastore

rocketechgroup/gcp-batch-for-dbt

Run DBT using the GCP Batch service

rocketechgroup/airflow2-data-aware-scheduling

rocketechgroup/auditlog-examples

rocketechgroup/aead-encrypt-decrypt

rocketechgroup/analytics-hub-pubsub-demo

Analytics Hub PubSub Demo

rocketechgroup/bigquery-storage-read-api-example

Example using BigQuery Storage Read API

rocketechgroup/chatgpt-api-boilerplate

rocketechgroup/composer-local

rocketechgroup/dataflow-split-file

Split files by context using partition based pattern matching

rocketechgroup/event-driven-bigquery-consumer

Track BigQuery table updates and turn them into events

rocketechgroup/fake-t-shirt-spanner-cdc

A fake t shirt project to test out spanner's CDC

rocketechgroup/handle-late-arriving-data-using-workflow

Using Workflow to handle late arriving data

rocketechgroup/jit-on-cloud-run

JIT - just-in-time access app on Cloud Run

rocketechgroup/log-analytics-review

Using SQL with BigQuery for log data is now a reality

rocketechgroup/ordered-data-snapshot-with-pubsub-and-datastore

rocketechgroup/rag_examples

rocketechgroup/speech-to-srt

Speech to SRT example