/proXXy

A super simple multithreaded proxy scraper, scraping HTTP, SOCKS4, & SOCKS5. Generates & checks ~80k proxies in ~5 minutes.

Primary LanguagePythonMIT LicenseMIT

Typing SVG


proXXy is a powerful tool designed for acquiring and managing a vast quantity of proxies. Its primary purpose is to gather, organize, and provide HTTP, SOCKS4, and SOCKS5 proxies. You can use them to do web scraping, penetration testing, bypassing censorship, simulated DDoS attacks, and more!

The software is currently capable of retrieving over 80,000 proxies from approximately 100 different sources.

This project is for educational purposes only— Please do not use this for illegal activities.

Installation

To install proXXy, follow these steps:

Clone the repository:

git clone https://github.com/Atropa-Solanaceae/proXXy.git

Navigate to the project directory:

cd proXXy

Install the required dependencies:

pip3 install -r requirements.txt

Usage

  1. Ensure all files are within the same directory.
  2. Run the program:
python3 proXXy.py
  1. Select the execution parameters.
  2. Allow the program to complete, then check the new text files located in scraped/ directory!

The program will output three files in the project directory containing the regularized proxy lists: HTTP.txt, SOCKS4.txt, and SOCKS5.txt, along with an error output file titled error.log noting the links that were unable to be accessed.

Planned Features

  • Fix using random user agents. (Currently breaks the testing)
  • Implement a feature for automatically testing the scraped proxies to verify their functionality. (1/3rd completed)
  • Proxy sorting instead of hardcoding.
  • Provide an option to discern between Elite, Anonymous, and Transparent anonymity classes of proxies.
  • Add support for HTTPS proxies.

Added Features

  • Added output folder for brevity.
  • Added more user parameters.
  • Verified proxies are written to checked file.
  • Improve error handling and logging for more informative feedback to the user.
  • Added a function to remove duplicate proxies from the generated lists.
  • Added a function to regularize proxies by removing trash values.
  • Updated the proxy scraping function to use contextlib.suppress for better error handling.

License

This project is licensed under the MIT License. See the LICENSE file for more information.

img