scrapinghub/python-scrapinghub

Difference between jobs.iter and jobs.iter_last

Opened this issue · 0 comments

The documentation for jobs.iter says

by default :meth:Jobs.iter returns maximum last 1000 results.
which implies that it will return the most recent (first 1000 sorted in decreasing chronological order).

The documentation for jobs.iter_last says

Iterate through last jobs for each spider.
which implies that it will return the jobs with the highest chronological value (that is to say, the first n jobs sorted in decreasing chronological order).

I would guess that they're not both returning the latest jobs, however with limited job retention I can't imagine a situation where you'd actually want the results in increasing chronological order.