A web crawler written in Go For a full explanation of this code check out the blog post: http://6brand.com/build-a-web-crawler-in-go.html