Pinned Repositories
fetchbot
A simple and flexible web crawler that follows the robots.txt policies and crawl delays.
gocrawl
Polite, slim and concurrent web crawler.
goquery
A little like that j-thing, only in Go.
purell
tiny Go library to normalize URLs
rehttp
Package rehttp implements a Go HTTP transport that handles retries.
urlesc
Proper URL escaping as per RFC3986
PuerkitoBio's Repositories
PuerkitoBio/goquery
A little like that j-thing, only in Go.
PuerkitoBio/gocrawl
Polite, slim and concurrent web crawler.
PuerkitoBio/fetchbot
A simple and flexible web crawler that follows the robots.txt policies and crawl delays.
PuerkitoBio/purell
tiny Go library to normalize URLs
PuerkitoBio/rehttp
Package rehttp implements a Go HTTP transport that handles retries.
PuerkitoBio/urlesc
Proper URL escaping as per RFC3986