/spark-on-k8s-gcp-examples

Example Spark applications that run on Kubernetes and access GCP products, e.g., GCS, BigQuery, and Cloud PubSub

Primary LanguageJavaApache License 2.0Apache-2.0

This is not an official Google product.

Accessing GCP Products in Spark

This repository is for examples showing how to access Google Cloud Platform products such as Google Cloud Storage (GCS), BigQuery, and Cloud PubSub as data sources or sinks in Spark on Kubernetes applications. Please refer to the README in each example directory for details on how to build and run the example.