Dask workers job with `when_to_transfer_output = ON_EXIT_OR_EVICT`
Opened this issue · 0 comments
ttedeschi commented
What would you like to be added?
Default setting for Dask worker job when_to_transfer_output = ON_EXIT_OR_EVICT
Why is this needed?
If when_to_transfer_output = ON_EXIT_OR_EVICT is enabled for the Dask worker, the output is transferred to the spool if condor_vacate_job is performed on the job
This should be used together with a patch to the job_rm.sh script in which condor_rm is subsituted with condor_suspend. Crashing jobs can then be resumed with condor_continue and then vacated as described above.