/WebCrawler

Web Crawlers for Research Purposes

Primary LanguagePython

Amazon Product Review Crawler

URL: https://www.amazon.com/

Amazon.com is an online social media which is focused on online shopping mall. Amazon customers are allowed to leave their comments for any products they purchased. To utilize the review data for information retrieval or else, you can utilize this review data crawler.

COLOURlover Favourite Color Theme Crawler

URL: http://www.colourlovers.com/

COLOURlover is an online crowdsourcing platform which lets random online users share anything about colours or artistic works. Although COLOURlover API is publicly available, it does not provide the exact data form which I needed for my research, here I built myself the data crawler.

Open Spotify Crawler

URL: https://open.spotify.com/

Spotify is one of the most popular music websites. This webcrawler collects titles and artists of a given playlists. To utilize this crawler, you need to specify a list of URLs which you wish to crawl.

All crawler in this repository is only for academic research purposes.

© 2019 Taewook Kim ALL RIGHTS RESERVED