Reduce stage should fail faster if any individual task fails
Closed this issue · 0 comments
delucchi-cmu commented
Bug report
The wait_for_futures method will report individual failures, but for the reduce step, we should fail immediately on the first failure, as there's little point in continuing on if some pieces fail.
Before submitting
Please check the following:
- I have described the situation in which the bug arose, including what code was executed, information about my environment, and any applicable data others will need to reproduce the problem.
- I have included available evidence of the unexpected behavior (including error messages, screenshots, and/or plots) as well as a descriprion of what I expected instead.
- If I have a solution in mind, I have provided an explanation and/or pseudocode and/or task list.