/etl-reference-architecture-pocs

Proof-of-concepts validating a reference architecture of a ETL data pipeline in the Erlang ecosystem designed for DNN serving DNN training data

Primary LanguageElixir

POC for an ETL pipeline evaluated in the context of DL

Prerequisites

First step install Elixir. A nix flake is provided to enter an ephemeral development environment with everything you need in there. To enter, run nix develop.

To reproduce

  • iex -S mix lets you play with the code in Elixir's repl
  • mix benchmark or mix run benchmark/*.exs