Very simple image scraper to download all the images on the deprecated ICUTKD website.
Built with Scrapy (and in a rush).
Set IMAGES_STORE
in settings.py
.
pipenv install
pipenv run scrapy crawl taekwondobot
This will save images into IMAGES_STORE/ALBUM_NAME/FILENAME
.
- Go to the page that lists all the albums.
- Get the links to all the albums
- Visit each album and download the photos
Pretty simple.