Way of saving state
Opened this issue · 1 comments
jmount1992 commented
Save progress/state to reduce time for rerunning with slightly altered settings, or if it crashes due to a config error.
jmount1992 commented
Basic progress state between execution has been included. Currently, runs if there is any difference in the dictionary config for topic between current and previous execution. Improvements could be made including:
- Do not rerun complete extraction if only filename/output_destination has been changed
- Extraction of topic data (i.e., images) and generation of the transform list for the topic, if required, could be separated
Main question is how to develop feature in a way that is extensible for when additional messages are added to the list of extraction topics, that may not fit current setup.