Spix0r/robofinder
Robofinder retrieves historical #robots.txt files from #Archive.org, allowing you to uncover previously disallowed directories and paths for any domain—essential for deepening your #OSINT and #recon process.
PythonMIT
Stargazers
- 0A7V9A0a7v9a
- afshinShh
- aldersondarlene
- AmirkhaksarNamaadIran
- an3ker
- atxiiiNear Cats
- awirshf45d/dev/null
- EmadYaY@HadessCS
- erfanSVG
- fawlid
- felipetruman127.0.0.1
- Hackerongithub
- IR4N14NYour Ethernet Cable
- itsallpretend
- itsmatinxMiddle Earth
- Jamalakhtar
- mahdi24rad
- mamad-1999127.0.0.1
- maverick0o0
- Mehran-KClocalhost
- meiadnoushadiiran-shiraz
- mersad-Bxtrue
- MhnXpIran
- miladkeivanfar
- mohammadsec
- Nematisme
- Normalitee0osIndia
- omid001php
- Q0120S
- salmaniraniKimiya co
- sangamahesh
- Sh4d0wHunt3rX
- shahryarjb@mishka-group
- The-NightFall
- w4ck3l
- zhifana