GoogleCloudPlatform/public-datasets-pipelines

Issues

• Dependency Dashboard

  #51 opened 4 years ago by forking-renovate
  0

• !

  #740 opened 8 months ago by jackoff482940
  2

• Vaccination Search Insights dataset splitting CSV files

  #255 opened a year ago by shanecglass
  0

• Require unit tests to be written for custom scripts used by pipelines

  #8 opened 4 years ago by adlersantos
  0

• Apple M1 numpy install issue

  #512 opened 2 years ago by brandonruhl
  0

• Dataset Pipeline looks misplaced.

  #277 opened 3 years ago by happyhuman
  0

• Transition container images to use Artifact Registry

  #249 opened 3 years ago by adlersantos
  0

• Documentation for folder hierarchy and navigating around the repo

  #213 opened 3 years ago by adlersantos
  0

• Allow BigQuery dataset IDs that differ from the dataset folder name

  #88 opened 3 years ago by adlersantos
  0

• `noaa.lightning_strikes_by_year` should use the `noaa_lightning` dataset

  #207 opened 3 years ago by adlersantos
  0

• Add Dockerfile linter as a check

  #187 opened 3 years ago by adlersantos
  0

• Consider utilizing GKE Operators in anticipating of shifting to Composer v2

  #186 opened 3 years ago by leahecole
  1

• Don't track any generated `Pipfile`s inside the `datasets` folder

  #151 opened 3 years ago by adlersantos
  0

• Use backport providers for DAG generation

  #12 opened 3 years ago by leahecole
  1

• Containerize custom tasks

  #5 opened 3 years ago by adlersantos
  5

• YAML config samples for DAGs using Airflow 2 operators

  #137 opened 3 years ago by adlersantos
  0

• Add best practices about certain data representation

  #108 opened 3 years ago by leahecole
  0

• Add explanations for `catchup` and `default_view` in the DAG config

  #128 opened 3 years ago by adlersantos
  0

• Specify how to use BigQuery `schema_fields` based on use case

  #127 opened 3 years ago by adlersantos
  0

• Replace COVID-19 sample dataset in README

  #126 opened 3 years ago by adlersantos
  0

• Pin dependencies + add bot

  #28 opened 3 years ago by leahecole
  1

• Add header-checker bot for license header checking

  #93 opened 3 years ago by leahecole
  0

• Mechanism to store shared variables used by multiple DAGs in a single place

  #100 opened 3 years ago by adlersantos
  0

• Support partitioning and clustering for BQ tables

  #114 opened 3 years ago by adlersantos
  0

• Check for missing or incorrectly named variables during a DAG deploy

  #102 opened 4 years ago by adlersantos
  0

• Use conventional pre-commits to enforce while committing

  #99 opened 4 years ago by adlersantos
  0

• Datasets without `variables.json` should still deploy properly

  #16 opened 4 years ago by adlersantos
  0

• Use lifecycle ignore changes for Terraform resources

  #78 opened 4 years ago by adlersantos
  0

• Support JSON file references in YAML config

  #69 opened 4 years ago by adlersantos
  0

• Support self-referencing variables in YAML

  #65 opened 4 years ago by adlersantos
  0

• BigQuery dataset description is not generated on Terraform

  #60 opened 4 years ago by adlersantos
  0

• Action Required: Fix Renovate Configuration

  #43 opened 4 years ago by forking-renovate
  0

• Add the ability to deploy a single pipeline

  #14 opened 4 years ago by adlersantos
  0

• Option to include remote state bucket when generating Terraform files

  #33 opened 4 years ago by adlersantos
  0

• Add renovate bot

  #34 opened 4 years ago by adlersantos
  0

• Terminology change: from datasets > dataset > pipeline; pipelines > pipeline_group > pipeline

  #30 opened 4 years ago by adlersantos
  1

• Templating tool for simple pipelines

  #31 opened 4 years ago by adlersantos
  0

• Support CSV column renaming without having to use custom scripts

  #25 opened 4 years ago by adlersantos
  0

• automatically test pipelines

  #11 opened 4 years ago by tswast
  0

• automatically generate DAGs and Terraform for PRs

  #10 opened 4 years ago by tswast
  0

• Organize a dataset's `.tf` files under a single folder

  #1 opened 4 years ago by adlersantos
  1