This repository contains example DAGs, requirements.txt, plugins, and CloudFormation templates focused on Amazon MWAA. Since Amazon MWAA is running open-source Apache Airflow many of the contributions will be applicable for self-managed implementations as well.
We want examples of as many use cases in this repository as possible! Please submit a Pull Request if you would like to add something.
Example Directed Acyclic Graph (DAG) workflows that have been tested to work on Amazon MWAA. Associated requirements.txt will be referenced to the entry in the next section. See Amazon MWAA documentation for details.
- Move your Apache Airflow Connections and Variables to AWS Secrets Manager
- Amazon Managed Workflows for Apache Airflow (MWAA) and Amazon EMR
- Interactive Commands with Amazon MWAA and Bash Operator
- Duplicate an existing RBAC role and assign to a user
- Return DAG ID when parsed during task execution
This folder contains complete set of sample use cases including documentation, infrastructure as code, and dependant resources. Follow the README.md in each use case to get started.
- Image Processing Pipeline
- Amazon MWAA with AWS CodeArtifact for Python dependencies
- Stop and Start MWAA
Sometimes getting the right combination of Python libraries is tricky. This repository is here to help. See Amazon MWAA documentation for details.
Most Airflow community plugins will work fine on Amazon MWAA. This repository is for specific examples that have been testing on the service. See Amazon MWAA documentation for details.
Example CloudFormation templates for Amazon MWAA. See AWS CloudFormation documentation for details.
Example AWS IAM Policy definitions. See Amazon MWAA documentation for details.
These examples all assume a working Amazon MWAA environment.
See CONTRIBUTING for more information.
This library is licensed under the MIT-0 License. See the LICENSE file.