Clear payloads at startup with the associated MIG instance
mocsharp opened this issue · 1 comments
Is your feature request related to a problem? Please describe.
At AIDE, replicas of MIG are deployed sharing the same instance of MongoDB.
Now, if one of instances goes down and comes back up, MIG Payload Assembler would clear out the Payloads collection/table which may also destroy payloads that are being processed by other instances of MIG.
Describe the solution you'd like
Associate each payload object with the machine ID/name and only delete payloads that are relevant.
Describe alternatives you've considered
Delete payloads that are older than some configured value (e.g. 1 hour)
Additional context
During startup, Payload Assembler clears out all payloads that are in the database to avoid sending an incomplete workflow request.