trickest/cloud

How to search for a specific domain?

Sachinart opened this issue · 3 comments

Hi, absolutely awesome. Thank you very much for this amazing project.

I wanna search for a specific domain for an example: apple.com, So how I will know like in which file that exists or if that's not possible to search here then I have to download whole directory and then I have to search that using regex or any script?

Thank You!

hi , you can use my tool :D cloud_data
If it was useful, please give a star 😉

@Sachinart, I agree, searching through csv is a pain.
GitHub Code Search won't index this repo either.

@mhmdiaa should consider json too
here's how to convert the csvfiles to json using csvtk

!# From a git cloned repo
find . -type f -name '*.csv' -exec sh -c 'csvtk csv2json "$1" > "${1%.csv}.json"' _ {} \;
!# This will generate a json file for each of the csv files

!# Or a Single Big one:
find . -type f -name '*.csv' -exec csvtk csv2json {} \; > "/tmp/csv2.json"

@mrvcoder love your tool, thanks for that.
However, it's too much setup, and If I try with many domains (> 10), my system freezes and it takes a long time.

To solve all these problems, I have decided to make the data (Parsed & Cleaned) available at:
https://pub.ajam.dev/datasets/sni-ip-ranges/

This also contains data from http://kaeferjaeger.gay/?dir=sni-ip-ranges

@Azathothas thanks , actually my tool runs with github actions and for multiple domains I think it can handle it.