login
login to save cookie
npm run login
step 1 - fetch to local
follow steps in your terminal
git clone https://github.com/coooo77/facebookPhotoCrawler.git
cd facebookPhotoCrawler
npm install
step 2 - create config.json file in src folder
- puppeteerConfig.executablePath - path of chrome.exe
- puppeteerConfig.headless - set it false to show crawler brower
- screenshotWeb - take screenshot from website
- destination: url from facebook, e.g. https://www.facebook.com/photo.php?fbid=XXX&set=XXX
- fullLoad - Waiting for the website to load completely
- retryLimit - Retry attempts on disconnection. If not set, the web crawler will immediately terminate on network disconnection, with a maximum limit of 120 attempts.
// src\config.json
{
"puppeteerConfig": {
"headless": false,
"executablePath": "path/to/chrome.exe"
},
"destination": "url to facebook photo gallery",
"screenshotWeb": true,
"fullLoad": false,
"retryLimit": 30
}
step 3 - execute program
npm start