stewartmckee/cobweb
Web crawler with very flexible crawling options. Can either use standalone or can be used with resque to perform clustered crawls.
JavaScriptMIT
Stargazers
- addameCanaDA
- adelevie@casetext
- ahamxBetterlabs
- amalhotra
- AndySzeEarth
- carlosmoutinhoBerlin
- dannguyendata scientist wrangler/engineer
- davidcollomStaff Solutions Engineer @Jetstack
- egtann@gladly
- ezklOakland, CA
- falievSan Francisco Ca
- ferhatsbwww.sebula.com
- gmanleyChicago
- gmpabloGreen Media Agency
- haifengToronto, Ontario
- holidayworkingKawaski, Kanagawa, Japan
- kakutaniFreelance, Ruby-no-Kai
- lulalalaGitLab
- m040601somecompany1
- marshlucaChina
- mcastilhoKnowBe4
- mjcloutierExperian, Inc.
- PatrickTulskieThe Lifetime Value Co.
- probablykabariChicago, IL
- robertomirandaBristol, UK
- rojotekConsenSys
- saastisfySaastisfy
- sgonyeaGoogle
- Sija
- tcoppleCapstone Investment Advisors
- thomasdavisFree
- tzusmanBoulder, CO
- vinh0604@open-fabric
- voipscout
- wenzowski@button-inc
- XORwellMunich, Germany