ABrisset's Stars
swalker-888/google-indexing-api-bulk
Submit URLs in bulk to Google's Indexing API using a batch request
rootVIII/proxy_requests
a class that uses scraped proxies to make http GET/POST requests (Python requests)
ankane/blazer
Business intelligence made simple
512banque/uule-grabber
Uule parameter used for geolocation by Google
taganaka/polipus
Polipus: distributed and scalable web-crawler framework
stewartmckee/cobweb
Web crawler with very flexible crawling options. Can either use standalone or can be used with resque to perform clustered crawls.