Closed this issue 7 years ago · 1 comments
Handle exceptions so that the crawler does not stop.
Check if the HTTPError is because a 404