/goscrapy

A web crawling and scraping framework for golang.

Primary LanguageGoApache License 2.0Apache-2.0

goscrapy

Go Report Card License

goscrapy is a web crawling and web scraping framework written by golang. The architecture of goscrapy is similar to python-scrpay, and described as following:

Data Flow

Easy to use

An example usage is available at here.

goscrapy-cli is a command line tool which is helpful to auto-generate code template for you, see goscrapy-cli for more details.