/Data-Analysis-using-Pyspark

Working with pyspark module in python and using google colab environment in order to apply some queries to the dataset. The dataset consist of two csv files listening.csv and genre.csv. Also, visualizing query results using matplotlib.

Primary LanguageJupyter Notebook

Data Analysis using Pyspark

  • Importing first csv file of our dataset
  • Using pyspark sql data frame
  • Queries to extract useful information
  • Importing second csv file of our dataset
  • Merging two data frames and prepare it for more advanced queries
  • Visualizing results using matplotlib