/dataeng-gmapscrawler

This crawler, made using Selenium WebDriver, interfaces Python code with results retrieved from Google Maps search engine into dictionaries or Pandas dfs. For educational purposes only.

Primary LanguagePythonMIT LicenseMIT

GMaps Crawler

Table of Contents

1. About the project

The purpose of this project is to deploy a platform to collect data from Google Maps by using code in a easy way. Based on the usage of it, you will be able to execute commands to retrieve search results about locations and places.

Built with

  • Python 3.8
  • Selenium WebDriver for Python

2. Requirements

  • Python 3.8 installed
  • Google Chrome Browser installed
  • ChromeDriver downloaded (chromedriver.exe available on your computer - see 3. Getting Started)

3. Getting Started

  • Downloading Chromedriver and making it visible to this project source code

  1. Download the driver chromedriver.exe compatible with the Chrome browser installed on your computer. You can download it here:

  2. Setup in your OS an environment variable called CHROMEDRIVER_PATH, containing the path for the driver on your computer (e.g. C:\chromedriver\chromedriver.exe).

  • Cloning this project and installing its dependencies

  1. Clone repository:

git clone https://github.com/smurilogs/gmaps-crawler.git

  2. Install dependencies:

python -m pip install --upgrade pip
python -m pip install -r requirements.txt

4. Basic Usage

work in progress...

5. License

Distributed under the MIT License. See LICENSE for more information.