duckduckgo/tracker-radar-collector
🕸 Modular, multithreaded, puppeteer-based crawler
JavaScriptNOASSERTION
Issues
- 6
Dependency issue: outdated version of `puppeteer` and vulnerable versions of `node-fetch`
#84 opened by gunesacar - 4
- 3
Heuristic cookie popup detection update makes CMP collector miss some CMP prompts
#80 opened by stevenwdv - 0
List of entities and services
#85 opened by pooneh-nb - 5
- 0
Add a collector hook for post-load actions
#76 opened by muodov - 3
- 1
logged-in crawls
#73 opened by pooneh-nb - 1
Some requests made by popups are not recorded.
#47 opened by kdzwinel - 5
Introduce crawl config file
#35 opened by kdzwinel - 0
Make `MAX_LOAD_TIME` configurable
#59 opened by kdzwinel - 0
- 0
Make UA and viewport configurable via config
#62 opened by kdzwinel - 2
- 3
- 0
- 0
Big performance crawls
#34 opened by kdzwinel - 1
waitFor being deprecated by Puppeteer
#29 opened by SlayterDev - 0
- 0
Fix: "Crawl failed. Session already detached. Most likely the iframe has been closed."
#31 opened by kdzwinel - 0
Get rid of the collector hotfix
#23 opened by kdzwinel - 2
- 1
Store headers received in the responseReceivedExtraInfo event if a matching request cannot be found
#21 opened by gunesacar - 2
Any plans to include ua-client-hints
#12 opened by abrahamjuliot - 1
Alpha map
#16 opened by mbartlett505 - 4