We extend an existing crawling tool with our methodology, and open source our framework and dataset in order to promote further research and enable fellow researchers, policy makers or even end-users to further inspect Indian news websites on the basis of tracking and partisanship. These codes and links to the tools used in our paper are listed below.
Note: The labelled dataset of Indian News Websites and crawls using these scripts can be requested from our dataset page https://nms.kcl.ac.uk/netsys/datasets/india-tracking/ (Please abide to our listed T&C).
India is experiencing intense political partisanship and sectarian divisions. The paper performs, to the best of our knowledge, the first comprehensive analysis on the Indian online news media with respect to tracking and partisanship. We build a dataset of 103 online, mostly mainstream news websites. With the help of two experts, alongside data from the Media Ownership Monitor of the Reporters without Borders, we label these websites according to their partisanship (Left, Right, or Centre). We study and compare user tracking on these sites with different metrics: numbers of cookies, cookie synchronizations, device fingerprinting, and invisible pixelbased tracking. We find that Left and Centre websites serve more cookies than Right-leaning websites. However, through cookie synchronization, more user IDs, are synchronized in Left websites than Right or Centre. Canvas fingerprinting is used similarly by Left and Right, and less by Centre. Invisible pixel-based tracking is 50% more intense in Centre-leaning websites than Right, and 25% more than Left. Desktop versions of news websites deliver more cookies than their mobile counterparts. A handful of third-parties are tracking users in most websites in this study. This paper, by demonstrating intense web tracking, has implications for research on overall privacy of users visiting partisan news websites in India.
The paper PDF is available here.
Dataset Curationfolder contains crawling scripts used in curating the news websites' list and dataset.Cookie Analysisfolder contains analysis scripts used in cookie-based tracking analysis.Cookie Synchronizationfolder contains analysis scripts used in cookie synchronization.Device Fingerprintingfolder contains analysis scripts used in device fingerprinting analysis.Invisible Pixelsfolder contains analysis scripts used in invisible pixel-based tracking analysis.
Please cite our paper:
@inproceedings{agarwal2021under,
title={Under the Spotlight: Web Tracking in Indian Partisan News Websites},
author={Agarwal, Vibhor and Vekaria, Yash and Agarwal, Pushkal and Mahapatra, Sangeeta and Set, Shounak and Muthiah, Sakthi Balan and Sastry, Nishanth and Kourtellis, Nicolas},
booktitle={Proceedings of the International AAAI Conference on Web and Social Media},
volume={15},
pages={26--37},
year={2021}
}