/airflow_ml_ops

Sample Airflow ML Pipelines

Primary LanguageJupyter NotebookApache License 2.0Apache-2.0

Airflow ML Pipelines - [DRAFT]

Sample Airflow ML Pipelines

Installation for Google Cloud Integration

pip install 'apache-airflow[gcp]'

Details - https://airflow.apache.org/docs/stable/installation.html

Available GCP Integrations

Full list - https://airflow.apache.org/docs/stable/integration.html#gcp-google-cloud-platform

  • Cloud Functions

  • Bigquery

  • AutoML

  • Google Cloud Storage

  • Google Sheets

  • AI Platform

  • Video Intelligence, Vision, Natural Language APIs

Additional Airflow/Cloud Composer Resources