A quick configurable image scraper using x-ray and node-image-downloader for 2020.
Adjust configuration as needed
- Starting on line 6 of index.js, update baseURL, URL, and selector variables to suit your needs.
- If you're just wanting to grab the image src attribute leave line 12 as is. You can add properties to the shape object, if you need any other attributes from the source data (i.e. alt or class attributes for subsequent filtering). See x-ray docs.
- Before you execute your scraper, make sure the destination directory exists. I might update the project to support non-existant destination directories in the future.
Scrape away
imageDownloaderis returning a promise. If you have any doubts or need to adjust logging, take a look at any errors in the console and adjust your logging as needed in xray's callback. See node-image-downloader docs for more information.