Notes:
- Use "--config core.autocrlf=input" at the end of the git clone command. More info
Dagster is an OpenSource tool that eliminates the barrier between development and operation, and at the same time brings business processes closer. We will discuss its basic concepts and develop a complete data pipeline applying them, always keeping the data in the foreground.
You will start by reading the Introduction, where you will have access to all the chapters of the workshop as well as information about the workshop requirements.
| Name | Description |
|---|---|
.devcontainer |
configuration to provide a fully featured development environment |
doc/ |
each chapter of the workshop will be explained in an extended way here |
docker/ |
definition of containers on which we will develop |
pulpocon23_dagster/ |
python module for Dagster project |
scripts/ |
utils for makefile |
tests/ |
python tests for Dagster project |
Makefile |
automating software building procedure |
scripts/ |
utils for makefile |
pdm.lock |
resolved result of all dependencies from pyproject.toml |
pyproject.toml |
PDM dependencies configuration |
README.md |
description and guide for the code repository |
PulpoCon · 2023
Dagster Workshop
david.fernandez@nextail.cojulien@nextail.co