Factual/smaker

alphabetically organize flag wildcards

max-hoffman opened this issue · 1 comments

Within an execution context flags are consistently organized, but between runs there is variability in the ordering. That a) makes it difficult to tell if something has already ran, b) means that partially failing jobs might try to re-start completely if flag positions are switched, and c) is annoying when I'm trying to compare results from different execution runtimes.

If flags are alphabetically organized then it will be impossible to accidentally introduce that variability (can't rely on ordered dict because users can reorganize params).

the variable options also need to be ordered, same problem as above