/LinkJoin

Primary LanguageJavaScript

LINK JOIN!

Slides

Goal

An advertiser, data-scientist, politician, or casual user might find the feature of knowing who goes into one subreddit from another useful for the purpose of targeted marketing, insights, knowing how which reddit users feel about which political ideologies, or straightup 'cool' factor. My project was joining all the conversations that happen across reddit that lead to other subreddits. For instance, if there were two conversations that ended in direct recommendations to /r/politics, I'd put them in a graph together where both conversations point to the reference to /r/politics.

Implementation

I downloaded and extracted the files provided by a friendly reddit user onto S3 as my source of truth. Then I processed the files into the joined graphs pumped them into Redis, got em out and made them into svgs.