openwpm/OpenWPM

javascript_cookies contains records with visit_ids that don't show up in site_visits

Opened this issue · 0 comments

taehyung222 reported on Matrix:

Hello, I wanted some info on OpenWPM-0.16.0. I noticed that there are some visit_ids present in the javascript_cookies table that are not present in the site_visits table. In these cases I am not able to map the visit_id with the site_url. I would be grateful for help on this. TIA!!

I observed that 92 visit_ids were missing when I ran a crawl with 10 browsers in parallel on a 1k list. But with 5 and 3 browsers in parallel, there were zero missing. Seems like it could have been a resource constraint issue from my side, sorry

This might be related to #922 and be caused by the number of browsers running in parallel.