/sample-crawler

Sample Crawler

Primary LanguageGoThe UnlicenseUnlicense

sample-crawler

Sample Crawler

example usage

go: ./crawler -filename sitemap-news.xml -method wait-group|worker-pool

worker-pool go

wait-group go

python: python3 crawler.py --filename sitemap-news.xml

python crawler