A python program to get lists of proxy information from proxy websites.
It will create a sqlite database for proxy information including ip address, port, location and protocol.
Python version must greater than 3.3
Clone the code.
git clone https://github.com/SymeonChen/spider-proxy-pool.git
Install dependency.
sh install.sh
run the apps.
sh run.sh
Now we can get http proxy lists from
http://localhost:5000/api/http
用于从多个代理网站获取代理信息的Python项目。
运行后会创建一个sqlite数据库,包含IP地址,端口号,位置,协议。
Python版本需大于3.3
clone项目到本地
git clone https://github.com/SymeonChen/spider-proxy-pool.git
安装依赖模块
sh install.sh
运行项目
sh run.sh
运行完毕后即可通过
http://localhost:5000/api/http
来获取http代理列表。