/ScrapingChecker

ScrapingChecker is an Android library that simplifies web scraping permission validation by parsing robots.txt content, making it easy to determine if scraping is allowed for a given URL.

Primary LanguageKotlin

No issues in this repository yet.