antonio-bakula/Crawl2Excel

Crawl2Excel - crawler that crawls web site and extracts SEO data from web pages and saves the results in an MS Excel file. Multiplatform Console application that runs on Linux, OSX and Windows.

C#Unlicense

Issues

Pack dll-s into exe as resources
#15 opened 9 months ago
0
Add option to define user agent
#11 opened 9 months ago
0
Add options to configure threads used for crawler
#9 opened 9 months ago
0
Counter problems when over 1000 pages crawled
#8 opened 9 months ago
0
Add error and problems logging
#7 opened 9 months ago
0
Error 504. 503, 502
#6 opened 9 months ago
0
css parser exceptions
#4 opened 9 months ago
0
Include images, css, javascript and rest in crawl
#3 opened a year ago
0
Crawled url with PDF file has wrong mime type
#1 opened a year ago
0