dreamscale-io/gridtime

IdeaFlow engine - handle failure and eviction of torchie processes on error

accolasia opened this issue · 1 comments

When a torchie process fails, the circuit monitor should count the failure, and the program should be evicted from the execution engine, and the failure should display in the dashboard.

Processes that fail now halt the program, get evicted from the engine, and the dashboard is updated to show the failed processing. When the process resumes and the engine tries again, it now starts in the right place using the bookmark. When there is no more data to process, the program also finishes cleanly and is evicted without any errors.