Ge0rg3/requests-ip-rotator
A Python library to utilize AWS API Gateway's large IP pool as a proxy to generate pseudo-infinite IPs for web scraping and brute forcing.
PythonGPL-3.0
Pinned issues
Issues
- 1
Asyncio Integration / Multi threading ?
#71 opened by SaadTPTW - 1
Requests to subdomains
#70 opened by nzrv - 3
Reuse gateways without restarting
#69 opened by deeeeeelan - 2
Does this api support parallel processing?
#68 opened by jun3599 - 6
- 19
REST vs HTTP Api
#16 opened by simplexx - 4
- 2
rotate ip for selenium
#66 opened by jun3599 - 5
🔧 Integrate with Browser Automation tools
#61 opened by NorkzYT - 5
Returns 403 on EC2 but 200 Locally
#64 opened by sokffa - 4
Failed to delete API
#65 opened by 1nathanliang - 1
Keep One IP per request until it shutdown
#63 opened by zmkaihan - 5
Sending custom web schemes
#15 opened by nre226 - 3
- 1
Can no longer scrape google
#60 opened by sevmardi - 5
- 2
- 2
How gateway.start() navigate IP?
#57 opened by Raychanan - 1
- 1
Custom Header
#53 opened by wilrib - 2
GraphQL Queries
#55 opened by dante11235 - 4
How I can bypass cloudflare?
#51 opened by MsLolita - 1
GCP/Azure IP Rotation
#54 opened by codemonies - 0
Does API Gateway charge for 4XX/5XX errors?
#49 opened by codemonies - 1
- 2
Scraping amazon not working
#50 opened by arpitgoyall - 3
requests.exceptions.ConnectionError: HTTPSConnectionPool : Pool is Closed (On Some Connections)
#24 opened by Bewinxed - 0
Option to Require Manual Shutdown
#45 opened by Ge0rg3 - 6
Recurring 403 error
#46 opened by cia05rf - 6
Are the Proxies Elite?
#38 opened by MrCoder1453 - 3
REST API pricing per Region
#23 opened by L0k156 - 1
- 5
Batch opening and closing gateways?
#35 opened by mittster - 2
'ApiGateway' object has no attribute 'endpoints'
#41 opened by masdeval - 2
How to scrape google with amazon gateway api
#42 opened by muskansingh65553 - 2
- 1
Unable to scrape yahoo finance
#39 opened by ashishchow22 - 3
Unable to add parameters to request
#26 opened by tillea - 5
403: forbidden
#36 opened by jherrerogb98 - 3
Unable to download video
#37 opened by mittster - 1
How to log public IP used in each request?
#34 opened by bestrocker221 - 3
- 3
Unable to find credentials
#31 opened by KeparYTbcc - 1
Clarify AWS data transfer fee in README
#30 opened by xiaohk - 1
- 1
One random ip per session
#25 opened by stein-dev - 5
URL Encoding Not as Expected
#21 opened by hariravi - 1
Using requests-ip-rotator using async requests
#19 opened by vsanjairaj - 5
how to check if its working
#20 opened by AlexWayne20 - 1
With aiohttp
#18 opened by besteman