Frontera backend to guide a crawl using PageRank, HITS or other ranking algorithms based on the link structure of the web graph, even when making big crawls (one billion pages).
Primary LanguageCBSD 3-Clause "New" or "Revised" LicenseBSD-3-Clause