/scrlink

A go program to scrape image link from wikimedia category page

Primary LanguageGo

scrlink

A simple go program to scrape image links from wikimedia category page using colly scraping library.

It would take the wikimedia category page (example: https://commons.wikimedia.org/wiki/Category:Drawings_by_User:LuxAmber) and write the image links from the page into a text output.

Usage

Do a go build or a go install to run this program as a binary for convenience purpose.

./scrlink [WIKIMEDIA URL] [FILENAME]

example:

./scrlink https://commons.wikimedia.org/wiki/Category:Drawings_by_User:LuxAmber test.txt