Grailed-Scraper - WIP
Scrape images from listings on Grailed.com. I've included an example image dataset of six thousand images scraped from the search term "vintage sweaters".
Selenium and chromedriver required
Why?
I needed a large set of images to serve as training data for ML projects. However, Grailed doesn't have a public API (as of Dec. 2019) and existing Grailed scrapers retrieve listing data, but not images.
Features
- Scrape images
- Save listing designers to CSV
- Use Grailed api to resize images
- Efficient enough to save over 6k images in reasonable time
Todo
- General optimizations to increase efficiency
- Find optimal scroll length, this value is currently hardcoded
- CLI