A native Rust port of Google's robots.txt parser and matcher C++ library.
Primary LanguageRustApache License 2.0Apache-2.0
No one’s watching this repository yet.