/gobot

Quick and dirty internet crawler

Primary LanguageGoApache License 2.0Apache-2.0

Go Report Card Build Status

gobot

Quick and dirty internet crawler

Build

go build cmd/gobot.go

Run

./gobot <URL_TO_START_CRAWLING_FROM>

or

go run cmd/gobot.go <URL_TO_START_CRAWLING_FROM>

Monitoring

The Prometheus metrics are being exposed @ http://localhost:2112/metrics