/python-download-data

Python script to scrape / download various data sources.

Primary LanguagePythonMIT LicenseMIT

Python Download Data

Python script to scrape / download various data sources.

Setup

  1. Clone this repo:

    git clone git@github.com:yegorski/python-scrape-data.git
cd python-scrape-data

  2. Install Python script dependencies:

    pip3 install -r requirements.txt

Usage

From Zillow Static

Downloads files from http://files.zillowstatic.com.

  1. Make a .env file with the zillowstatic URL you want to download from:

    URL=http://files.zillowstatic.com/research/public_v2/zhvi/Metro_Zhvi_AllHomes.csv
SAVE_TO=files/Metro_Zhvi_AllHomes.csv

  2. Run python3 zillowstatic.py.

Kaggle

Downloads median-listing-price-1-bedroom data from Kaggle.

  1. Create a Kaggle account.

  2. Make a .env file with your Kaggle credentials:

    KAGGLE_USERNAME=<username>
KAGGLE_PASSWORD=<password>
URL=https://www.kaggle.com/zillow/median-listing-price-1-bedroom/download
SAVE_TO=files/listings.zip

  3. Run python3 kaggle.py.

  4. Unzip and inspect the downloaded file.