jimsmart/grobotstxt
grobotstxt is a native Go port of Google's robots.txt parser and matcher library.
GoApache-2.0
Stargazers
- 0x111Slovakia
- 5k3105
- Baakel
- benhoytCanonical
- bmilleareUK
- cezarmathe@kiwicorp @FieldMaterials
- denixport
- derekperkinsNozzle
- gmcabrita@amplemarket
- ik5:::1
- iv-p
- james-antill
- jdstorm
- kenleycapps
- lanastasovZaUtre
- libmonsoon-dev
- ligustahBCG Digital Ventures
- lucasflorianiBrazil / Santa Catarina
- maetthuBern
- marcobeiererSpiez, Switzerland
- mbsullivAtlanta, GA
- muesli
- nightlyone@freiheit-com
- r2pgl
- rabingaireWien, Ă–sterreich
- sashka@mokote
- shammishailajIndia
- srlehn~
- swithekEurope
- thanhtoan1196
- thomasfvarious
- tredoe
- tsdtsdtsdloadbee GmbH
- tuxcanfly@bcoin-org @handshake-org
- verdverm@topicalsource
- zeleninMoscow, Russia