/ScrapingChecker

ScrapingChecker is an Android library that simplifies web scraping permission validation by parsing robots.txt content, making it easy to determine if scraping is allowed for a given URL.

Primary LanguageKotlin

Stargazers

No one’s star this repository yet.