Support re-queueing stuck jobs

Question

Support re-queueing stuck jobs

jdmcd opened this issue 5 years ago · 6 comments

In order to fully complete conformance with the reliable queue pattern, the library should expose a hook that allows drivers to move idle jobs in processing back to the upcoming queue stack. This would be useful for jobs that get stuck if the process crashes.

Answer 1 · 2020-02-28T12:24:43.000Z

@tanner0101 is this something that might make it into RC tags? Or a future RC?

Answer 2 · 2020-02-28T14:12:46.000Z

I'd love to get it into the first RC but to be honest I haven't even scoped out what this feature looks like yet. I might have some time this weekend to take a look

Answer 3 · 2020-02-28T14:26:42.000Z

Sounds good. Ping me if you want some assistance in researching what this could look like.

Answer 4 · 2020-02-28T14:26:59.000Z

Will do, thank you!

Answer 5 · 2021-08-18T17:52:04.000Z

Is this still being researched? The current queue is not 'reliable', rather jobs that are dequeued by a worker are lost if the e.g. the worker crashes.

Answer 6 · 2021-08-21T20:14:33.000Z

@jjabo I have not looked at this in a while but would definitely want to add it if I ever had the time. But would be happy to review a PR!