/igoturls

WaybackURLS + OtxURLS + CommonCrawl = The Best Results

Primary LanguagePythonGNU General Public License v3.0GPL-3.0

I Got Urls

WaybackURLS + OtxURLS + CommonCrawl = The Best Results

Usage

python3 igoturls.py yourdomain.com

How it works?

  • Getting Urls from archive.org
  • Getting Urls from OTX AlienVault
  • Getting Urls from last three index of CommonCrawl
  • Doing all of that in the same time using threads.
  • Erasing the parameters.
  • Removing Duplicates.

Credit

This tool was inspired by @tomnomnom's waybackurls script. Thanks to them for the great idea!