Include incremental update mode
Opened this issue · 0 comments
AlainVagner commented
It would be interesting to be able to launch the crawler several times on the same site, detect new files and analyse only the accessibility of these new files.
Opened this issue · 0 comments
It would be interesting to be able to launch the crawler several times on the same site, detect new files and analyse only the accessibility of these new files.