A web crawler that leverages compute memoization techniques to enable lightning fast crawling of pages without sacrificing fidelity
Primary LanguageJavaScript