/try_gcp

Primary LanguagePython

Try Use Composer for word count

  1. Create Cloud Composer environment

  2. Create a Cloud Storage bucket

  3. Defining the workflow

  4. Uploading DAG to cloud storage

    gsutil cp spark_dibimbing.py <DAGs_folder_path>

  5. We use public data and copy to your Cloud Storage bucket

    public data to your Cloud Storage bucket

  6. The result is word count DAG and save to CSV