DReigada/CN-Project

RC-Project-Spark

This repository contains scripts to analyse the network of Users-Subreddits of reddit, using Apache Spark.

Meaningful Scripts

• CreateUserBuckets

  • Create itemset buckets for using in this script

• ReplaceNames

  • Changes the Subreddit ids to names for the output of this script

• ParseAssocRulesReplacingNames

  • Changes the Subreddit ids to names for the output of this script

Requirements

• Java 8 JDK
• scala (https://www.scala-lang.org/)
• sbt (http://www.scala-sbt.org/)

Running

1. Generate the binaries with sbt universal:packageZipTarball
2. Uncompress the generated file located at target/universal/cn-project-0.1.0-SNAPSHOT.tgz
3. Run the script inside <extractedDirectory>/bin that has the same name as the scala script you want to run