A library and script for working with 'robot.txt'.
Primary LanguagePerlGNU General Public License v3.0GPL-3.0