/WebCrawler

An android application which does web crawl

Primary LanguageJava

WebCrawler

This is an android application which does web crawl for hyperlinks. The app stops crawling when 1000 links are gathered without user intervention.

The UI button element which is labelled “Begin” if crawling not in progress else “Stop” to force stop crawling before 1000 links are gathered. Application utilizes up to 10 threads for crawling, It is capable of crawling gzip encoded pages and supports https connection.