jparise/apprankings

HTTP Error 403: Forbidden

Opened this issue · 4 comments

Getting repeated "HTTP Error 403: Forbidden" and no ranking results. Any idea why?

Everything appears to be working for me. Are you perhaps outside of the United States in a country without an official App Store presence?

In the US. But looks like they banned my IP- not sure why, is running this 2-4 times / day excessive?

Monkey patching with this code allows you to choose a different source IP if available:
http://stackoverflow.com/questions/1150332/source-interface-with-python-and-urllib2

Beyond this- I'm noticing a number of 301 redirect using the itunes.apple.com url as-is.

It appears that after numerous requests with the various genre and store IDs which are met with 301 redirects, the IP becomes banned, and instead receives 403 forbidden. I'm wondering if the requests are coming in too quickly so it exceeds some threshold they set.

I just pushed a change that allows the HTTP connection's source address to be set using a new command line argument: --source. Hopefully that will make it easier for you to work around the problems that you're seeing.

I don't have any new information to share about the larger problem, however. I'm definitely open to suggestions.