GoogleCloudPlatform/terraform-google-secured-data-warehouse

Add instructions for deploying Dataflow jobs

daniel-cit opened this issue · 1 comments

daniel-cit commented

Community Note

  • Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
  • Please do not leave +1 or me too comments; they generate extra noise for issue followers and do not help prioritize the request
  • If you are interested in working on this issue or have submitted a pull request, please leave a comment.
  • If the issue is assigned to a user, that user is claiming responsibility for the issue.

Description

Add documentation on the requirements to deploy new dataflow jobs in the secured data warehouse

  • which Identities are used in the deploy
  • list the need permissions
  • explain the need in python flex job of a Python module repository in the deploy of a job and detail the alternative used that does no require external internet access
  • detail the egress configuration in the VPC-SC perimeters
  • provide example of gcloud commands for both Python and Java flex tempates

References

erlanderlo commented

we'll need a simple write up for this initial mvp