/CS6301-YelpDataETL

ETL program to put data into MySQL for data visualization project

Primary LanguageC#

Data-Visualization

Install the following software

  1. Visual Studio 2015 CE
  2. MySQL Community Server 5.7.15
  3. MySQL Workbench 6.3
  4. Dotnet Core

Setup Database

  1. Open MySQL Workbench
  2. Connect to your instance of MySQL
  3. Create a new user yelp_etl, with same password as root. Give this user DBA permissions. Follow instructions

Prepare to run

  1. Download the dataset from Yelp
  2. Copy the following files into '/YelpDataChallenge/data`
  • yelp_academic_dataset_business.json
  • yelp_academic_dataset_checkin.json
  • yelp_academic_dataset_review.json
  • yelp_academic_dataset_tip.json
  • yelp_academic_dataset_user.json

Run

  1. Using Windows Command Prompt, navigate to YelpDataChallenge
  2. Run the following commands in this order:
  3. dotnet restore
  4. dotnet build
  5. dotnet run

This step should take a while...