python-arq/arq

[Question] `max_jobs` per job?

dev-techmoe opened this issue · 1 comments

It's there any way to set max_jobs param for each job?

For example, I have a crawler job for a website, I pushed 100 job to queue and only want 10 jobs running concurrently to prevent some API rate limit, but I have some job in same WorkerSettings that is not need to limit max_jobs, it's there any way to solve this?

I solved this problem by combine the queue_name prop of WorkerSettings and set the _queue_name param when enqueue job.

So fantastic library!