/go-crawler

Example project for a CLI that interacts with a web crawler server via gRPC.

Primary LanguageGo

go-crawler

Install CLI

cd crawl && go install

Run

Start the server:

cd server && go run main.go

In another terminal run the CLI with commands:

crawl -start <some-url> # start crawling a url
crawl -stop <some-url>  # stop crawling a url
crawl -list             # view site tree for all crawled urls