A Restful api to bypass Cloudflare's anti-bot and get the page contents for webscraping app.
A java implementation of this api can be viewed here.
npm install
npm start
or
npm run dev
The api is listening on the port 8888.
Path | Method | Fields | Description |
---|---|---|---|
/wait | POST | url | Wait for pages contents |
/get | POST | url | Initialize bypassing task |
/raw/{token} | GET | Raw response |
Param | Description |
---|---|
url | Website with the CloudFlare's Protection |
token | The request "/get" will return you a token |
Request for /wait with field https://kfaction.net/banlist :
curl --request POST \
--url http://127.0.0.1:8888/wait \
--header 'content-type: application/x-www-form-urlencoded' \
--data url=https://kfaction.net/banlist
Response :
{
"url": "https://kfaction.net/banlist",
"html": "html content here"
}
Request for /get with field https://kfaction.net/banlist :
curl --request POST \
--url http://127.0.0.1:8888/get \
--header 'content-type: application/x-www-form-urlencoded' \
--data url=https://kfaction.net/banlist
Response :
{
"token": "7Aap85Z4dd",
"startedAt": 1524321384,
"refreshAt": 1524326884,
"estimatedTime": 5500,
"rawUrl":"http://127.0.0.1:8888/raw/7Aap85Z4dd"
}
Request for /raw/7Aap85Z4dd :
curl --request GET \
--url http://127.0.0.1:8888/raw/7Aap85Z4dd
Response :
{
"token": "7Aap85Z4dd",
"finished": true,
"url": "https://kfaction.net/banlist",
"html": "html content here"
}