Simple concurrent web-crawler written in Go. Does not obey robots.txt and is only meant as an educational exercise.
Primary LanguageGo