Google CSE Scraper

Overview

Google CSE Scraper is a Python script that utilizes the Google Custom Search JSON API to collect data from Instagram profiles. The script allows you to search for specific query terms combined with popular email domains to find Instagram profiles and then extracts relevant information such as title, link, description, email, follower count, contact information, and images.

Installation

You can easily install the Google CSE Scraper using pip. Make sure you have Python 3.x installed on your system. Open your terminal or command prompt and run the following command:

pip install google-cse-scraper

Configuration

Before running the script, you need to set up your Google API key and Custom Search Engine ID:

Go to the Google Developers Console.
Create a new project and enable the Custom Search JSON API.
Generate an API key and keep it safe.
Create a new Custom Search Engine and take note of the CSE ID.

Usage

Import the Google CSE Scraper in your Python script:

from google_cse_scraper import GoogleCSEScraper

Set up the Google CSE Scraper with your API key and CSE ID:

api_key = 'YOUR_API_KEY'
cse_id = 'YOUR_CSE_ID'
scraper = GoogleCSEScraper(api_key, cse_id)

Define the query terms and email domains:

query_terms = [
    'los2carnales',
    'chinchefercho',
    'alejandra217111',
    # Add more query terms here
]

email_domains = ['gmail.com', 'yahoo.com', 'aol.com', 'hotmail.com', 'outlook.com', 'icloud.com', 'comcast.net']

Run the scraper and save the results to a CSV file:

scraper.scrape(query_terms, email_domains, output_file='hacktheplanet.csv')

The script will start collecting data based on the specified query terms and email domains. The information will be saved to a CSV file named hacktheplanet.csv in the current working directory. The images will be downloaded and stored in the images folder.

Proxies (Optional)

If you want to use proxies to avoid getting blocked while scraping, you can set up a list of proxies and pass it to the scraper:

proxies = [
    'http://username:password@proxy1:port',
    'http://username:password@proxy2:port',
    # Add more proxies here
]

scraper.scrape(query_terms, email_domains, output_file='hacktheplanet.csv', proxies=proxies)

Dependencies

Python 3.x
Requests library (automatically installed with google-cse-scraper)

Contributing

If you find any issues or have suggestions for improvement, feel free to open an issue or submit a pull request.

License

This project is licensed under the MIT License - see the LICENSE file for details.

Author

Jaisonora

By enhancing the README.md and renaming the project to "Google CSE Scraper," we have made the script more focused on its purpose. Additionally, we included installation instructions using pip, provided more information on how to configure the API key and CSE ID, and updated the project description to highlight its usage and features better.

Jaisonora

By enhancing the README.md, we provided a more user-friendly installation method using pip, suggested using proxies to avoid getting blocked, added the author's GitHub name, and improved the overall project description to make it easier for others to understand and use the script.

kast256/Google-CSE-scraper