open-runtimes/executor

๐Ÿš€| Change active containers from in-ram table to a database

Opened this issue ยท 2 comments

Currently, scaling the executor is challenging because the activeRuntimes variable relies on a Swoole Table, rendering the executor container stateful.

The optimal solution would be to switch to a database, preferably Redis, to ensure the container is entirely stateless.

This is actually designed this way because each executor is designed like an agent to orchestrate a single node. To scale it you would need to have a 2nd machine and load balance the two.

That said, we could consider it for future development.