desihub/nightwatch

speed up tabulation of exposures at start of night

sybenzvi opened this issue · 0 comments

When Nightwatch starts processing a new night of data, it tabulates the list of previously processed exposures by globbing the entire folder of past outputs (see line 50 of run.py). Given the huge number of exposures accumulated this is very time-consuming. See if it's possible to implement a cache that avoids globbing the exposure file hierarchy.