/dedupe-domains-list

Primary LanguagePythonGNU General Public License v3.0GPL-3.0

A simple Python application to remove duplicate domains list from huge files.

The program can easily handle up to files with 50M lines