jscrip/linkSpider

A JavaScript Link Crawler you can inject in the browser.

JavaScript

Issues

Stop the crawler if the site starts rejecting all requests
#2 opened 3 years ago by jscrip
1
Async requests seem to be ignored for HTTP2 connections
#3 opened 4 years ago by jscrip
0
Crawling the same URL more than once
#1 opened 4 years ago by jscrip
0