Service Unavailable
Opened this issue · 1 comments
sarment0 commented
[00:19:27] ERROR::email_crawler - Exception at url: http://www.google.com/search?q=something&start=0
HTTP Error 503: Service Unavailable
[00:19:27] ERROR::email_crawler - EXCEPTION: expected string or buffer
kevingatera commented
This is now solved by reducing the number of queries from 500 to 150. It was due to the fact that the script was querying google too many times and hence it was getting blocked.