pankajkoti

pankajkoti's Stars

• astronomer/astro-provider-ray

  This provider contains operators, decorators and triggers to send a ray job from an airflow task

  Language:Python143

• astronomer/astronomer-cosmos

  Run your dbt Core projects as Apache Airflow DAGs and Task Groups with a few lines of code

  Language:Python810178

• abhishekbhakat/Turbine

  Simple python script for easy local airflow deployment with docker. Packed with additional components. Will be adding more going forward.

  Language:Python3

• wagoodman/dive

  A tool for exploring each layer in a docker image

  Language:Go48.9k1.8k

• DataExpert-io/data-engineer-handbook

  This is a repo with links to everything you'd ever want to learn about data engineering

  Language:Jupyter Notebook24.2k4.4k

• ByteByteGoHq/system-design-101

  Explain complex systems using visuals and simple terms. Help you prepare for system design interviews.

  67.4k7.1k

• kaxil/airflowctl

  A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects

  Language:Python20216

• nordquant/complete-dbt-bootcamp-zero-to-hero

  Supplementary Materials for the The Complete dbt (Data Build Tool) Bootcamp Udemy course

  Language:Shell493362

• boto/botocore

  The low-level, core functionality of boto3 and the AWS CLI.

  Language:Python1.5k1.1k

• astronomer/starship

  Astronomer Starship can send your Airflow workloads to new places!

  Language:Python286

• apache/airflow

  Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

  Language:Python38.2k14.5k

• astronomer/astro-sdk

  Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

  Language:Python35947

• astronomer/astronomer-providers

  Airflow Providers containing Deferrable Operators & Sensors from Astronomer

  Language:Python14226

• OpenLineage/OpenLineage

  An Open Standard for lineage metadata collection

  Language:Java1.8k317

• MarquezProject/marquez

  Collect, aggregate, and visualize a data ecosystem's metadata

  Language:Java1.8k325

• airbytehq/airbyte

  The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

  Language:Python16.7k4.2k

• andkret/Cookbook

  The Data Engineering Cookbook

  Language:Python13.9k2.5k

• donnemartin/system-design-primer

  Learn how to design large-scale systems. Prep for the system design interview. Includes Anki flashcards.

  Language:Python285k47.5k