atlas
Atlas is a dynamic DAG (directed acyclic graph) task executor. You submit a list of tasks with dependencies, Atlas will sort and execute them based on their topological orders. In its simplest setup, Atlas runs in a single machine with thread pools and everything is stored in-mem. But it can be easily extended with pluggable storage/execution engines, e.g:
- Distributed task runners with Hazelcast
- Distributed task runners with Kafka
- Distributed task coordinator (router) with Kafka
- Persistent storage with RocksDB