/cdk-apache-airflow

Deploying Amazon Managed Apache Airflow with AWS CDK

Primary LanguagePythonMIT LicenseMIT

Data Airflow

TUTORIALS

airflow_cheap.svg

External projects that would be awesome to implement

  1. Flower UI
  2. Whirl
  3. Elyra ! (data science)
  4. ZenML ! (data science)
  5. Medium - Custom ui for airflow
  6. TAC - help to boilerplate
  7. X-tended api
  8. Logs to Cloudwatch

Data lineage that would be awesome to implement

  1. Datahub.io
  2. Databand.ai
  3. Marquez
  4. Atlan & Plugin

Amazing operators that would be awesome to implement

  1. EcsOperator
  2. AwsLambdaInvokeFunctionOperator
    1. you can use it unless it doesn't matter if you don't get a response from xcom
  3. KinesisOperator (not found, create it manually)
  4. FirehoseHook

RULES

  1. Avoid Using Operators, Only PythonVirtualEnvOperator is accepted.