How to search for a specific domain?
Sachinart opened this issue · 3 comments
Hi, absolutely awesome. Thank you very much for this amazing project.
I wanna search for a specific domain for an example: apple.com, So how I will know like in which file that exists or if that's not possible to search here then I have to download whole directory and then I have to search that using regex or any script?
Thank You!
hi , you can use my tool :D cloud_data
If it was useful, please give a star 😉
@Sachinart, I agree, searching through csv is a pain.
GitHub Code Search won't index this repo either.
@mhmdiaa should consider json too
here's how to convert the csvfiles to json using csvtk
!# From a git cloned repo
find . -type f -name '*.csv' -exec sh -c 'csvtk csv2json "$1" > "${1%.csv}.json"' _ {} \;
!# This will generate a json file for each of the csv files
!# Or a Single Big one:
find . -type f -name '*.csv' -exec csvtk csv2json {} \; > "/tmp/csv2.json"
@mrvcoder love your tool, thanks for that.
However, it's too much setup, and If I try with many domains (> 10), my system freezes and it takes a long time.
To solve all these problems, I have decided to make the data (Parsed & Cleaned) available at:
https://pub.ajam.dev/datasets/sni-ip-ranges/
This also contains data from http://kaeferjaeger.gay/?dir=sni-ip-ranges
@Azathothas thanks , actually my tool runs with github actions and for multiple domains I think it can handle it.