anna-geller/prefect-deployment-patterns

Code examples showing flow deployment to various types of infrastructure

DataflowOps Best Practices & Examples

Code examples showing:

• how to use Prefect
• flow deployments to various types of infrastructure

Blog posts about using and deploying Prefect

• Declarative Dataflow Deployments with Prefect Make CI/CD a Breeze
• Prefect 2.3.0 adds support for flows defined in Docker Images and GitHub Repositories
• Scheduled vs. Event-driven Data Pipelines — Orchestrate Anything with Prefect
• Event-driven Data Pipelines with AWS Lambda, Prefect and GitHub Actions
• Serverless Real-Time Data Pipelines on AWS with Prefect, ECS and GitHub Actions
• Deploy Prefect Pipelines with Python | by Jeff Hale
• Orchestrate Your Data Science Project with Prefect 2.0 | by Khuyen Tran
• Sending Slack Notifications in Python with Prefect | by Khuyen Tran
• Orchestrating Airbyte with Prefect 2.0 | by Nate Nowack
• Migrating Databricks Tasks from Prefect 1 to Prefect 2 | by Andrew Huang

Repository templates with CI/CD workflows

Useful Discourse topics

• Prefect Deployments FAQ
• Prefect Logging FAQ
• Prefect Agents and Work-Queues FAQ

Questions?

Reach out via Discourse or Slack