/crawl

Lightweight library for scalable crawlers in Go.

Primary LanguageGoApache License 2.0Apache-2.0

crawl

GoDoc Circle CI

Lightweight library for crawlers in Go.

HTML parsing and extracting is done thanks to goquery.

Usage

You can take a look at example crawler code.

License

                             Apache License
                       Version 2.0, January 2004
                    http://www.apache.org/licenses/