Issues
- 0
How do I configure the default HttpClientHandler ?
#242 opened by mediabuff - 0
Add SourceContext to log routines
#241 opened by nefarius - 1
- 0
Content.Text empty despite response code OK and Content stream contains data
#238 opened by seanarmstrong87 - 0
Crawl .jsp sites
#237 opened by Cizzl - 2
Are 304 responses properly handled?
#235 opened by replaysMike - 4
- 5
Sitemap.xml parsedlinks is empty
#220 opened by JoshTango - 2
Base URI logic of the HyperLinkParser doesn't respect terminated relative base tag values
#231 opened by thedeedawg - 2
Base URI logic of the HyperLinkParser breaks on Linux when faced with a root-relative base tag value
#230 opened by thedeedawg - 1
- 1
- 1
The PageRequester downloads the content by default
#228 opened by chjahnert - 4
- 1
Exception is thrown when redirect URI is relative
#229 opened by chjahnert - 2
- 2
Best way to do page-by-page crawling
#224 opened by okolobaxa - 1
Handling pagination
#222 opened by thebitbrine - 2
User Agent config value appears to be getting split on spaces and sending requests with multiple user-agent headers
#217 opened by entryspace - 1
On MacOS it's not possible to build this project
#183 opened by SabiKi - 0
Bot stop crawling without any error
#221 opened by Alex-queval1 - 1
Update Readme file?
#218 opened by JoshTango - 3
Add link text to ParsedLinks
#185 opened by truencoa - 1
Subdomains links are treated as external links
#213 opened by marcmarsinach - 1
Collection of links found
#219 opened by JoshTango - 1
How to implement the decision maker function
#216 opened by kunal0810 - 1
- 2
- 1
Abot as Static Site Generator
#210 opened by glikoz - 3
Is AbotX supported on .NET Core?
#189 opened by tudorserbanconnatix - 3
- 3
Cannot access Async events in newest version
#207 opened by JulioPablo - 1
Can't install package in VS 2017
#205 opened by MESWEB - 1
abot vs abot v2?
#204 opened by fatagun - 11
Library does not work when link crawled is very slow
#203 opened by sbonello - 1
- 3
Not FIPS compliant
#184 opened by lansdon2 - 1
Slash in robot txt is misinterpreted.
#186 opened by johnsenola - 6
Abot is getting "Request aborted" on responses that should be standard http 404 status
#187 opened by sjdirect - 3
HtmlAgilityPack Assembly Version
#192 opened by paulbackhouse - 4
Status on dotnet standard and dotnet core support
#200 opened by silashansen - 0
- 0
where is the robots.dll ??
#180 opened by longfeier - 1
Fails to load some websites
#201 opened by mohodhaka - 0
- 1
Cannot crawl on specific site
#190 opened by gbarnis - 4
- 1
Is there any way to pass context from the Crawler invocation to the PageCrawlCompletedAsync method?
#181 opened by tudorserbanconnatix - 1
user agent
#179 opened by f103mirage - 4
Question: how do HttpServicePointConnectionLimit and MaxConcurrentThreads interact?
#178 opened by benempson