BD2KGenomics/dcc-action-service

Eliminate busy wait on monitor

Opened this issue · 0 comments

The action service monitor (not in this repo, but intertwined with it) wastefully makes URL requests to the volatile Luigi database and to S3, and deals with more information than it needs to.

A possible fix for this problem would be to have the deciders insert the touchfile information into the monitor database, and limit the monitor to updating information from the Consonance job database. This reduces the number of outside calls in the monitor and only results in a minor update in the decider, presumably accompanied by a class to insert into the monitor database without explicitly dealing with database set-up.