Revert to auto scaling
Opened this issue · 1 comments
harry-gibson commented
Currently set to use basic scaling with fixed max number of instances, to get around task queue timeouts when exporting takes > 10 minutes (which it always does). Is there a way to still use auto scaling?
harry-gibson commented
Possibility: have the task runner complete immediately - don't keep polling, but store a taskid:email address in memcache or something.
Then run a totally separate cron service every few minutes regardless of users to poll the tasks stored in memcache and see if they're done.