๐| Change active containers from in-ram table to a database
Opened this issue ยท 2 comments
byawitz commented
Currently, scaling the executor is challenging because the activeRuntimes
variable relies on a Swoole Table, rendering the executor container stateful.
The optimal solution would be to switch to a database, preferably Redis, to ensure the container is entirely stateless.
eldadfux commented
This is actually designed this way because each executor is designed like an agent to orchestrate a single node. To scale it you would need to have a 2nd machine and load balance the two.
eldadfux commented
That said, we could consider it for future development.