/URLscraper

Simple URL scraper of target website HTML source code.

Primary LanguagePythonMIT LicenseMIT

URLscraper

Simple URL scraper of target website HTML source code.

Usage

python urlscraper.py <URL>

Example

$ python3 urlscraper.py https://ipleak.net

Links and paths found on [ https://ipleak.net ] :

/manifest.webmanifest?t=4
/static/css/index.css?ts=20220812
https://airvpn.org/landing/ipleak/
https://ipleak.net
#webrtcleak
#dnsleak
https://airvpn.org
https://ipv4.ipleak.net
https://ipv6.ipleak.net
https://ipleak.net:8000
https://ipv4.ipleak.net:8000
https://ipv6.ipleak.net:8000
https://ipleak.net:62222
https://ipv4.ipleak.net:62222
https://ipv6.ipleak.net:62222
https://airvpn.org/landing/ipleak-forum/
https://www.maxmind.com
https://airvpn.org/landing/ipleak/
/static/js/jquery-3.6.0.min.js
/static/js/moment-with-locales.min.js
/static/js/rtc-api.js
/static/js/index.js?ts=20220812
/static/images/logo-airvpn.png
/static/images/logotitle.png
/static/images/misc/wait.gif
/static/images/misc/wait.gif
/static/images/misc/wait.gif
/static/images/misc/wait.gif
/static/images/status/no.png
/static/images/flags/64x42/id.png
/static/images/logo-airvpn.png