georgetown-cset/article-linking

Improve handling of long-running tasks

Closed this issue · 0 comments

Right now cloud composer loses a connection to the simhash/ID creation task most weeks as this takes several days to run, meaning I have to manually monitor and restart. Use a sensor/other method to avoid this. Also, move to cloud composer 2 environment