A native Rust port of Google's robots.txt parser and matcher C++ library.
Primary LanguageRustApache License 2.0Apache-2.0
No issues in this repository yet.