daniellj/DistributedComputing

Distributed Computing models and frameworks for Big Data (MapReduce, Apache Spark)

Repository with case-study and example-models with DISTRIBUTED COMPUTING models.

Motivation

I created this repository for develop my skills with DISTRIBUTED COMPUTING, and sharing example-models with the community.

Frameworks:

Hadoop Map Reduce

Topics

• [1. Introduction]
• [2. Hadoop Platform]
• [3. Hadoop Architecture]
• [4. MapReduce Operation]
• [5. MapReduce - POC]

Apache Spark

Topics

• 1. Introduction
• 2. Apache Spark Platform
• 3. Apache Spark Architecture
• 4. Data Sources and Formats to Consume
• 5. Deploy Mode
• 6. RDD's - Resilient Distributed Datasets
  • 6.1. RDD - Transformations And Actions
  • 6.2. Pair RDD, Acumulators, Broadcast And_Partitions
• 7. Spark SQL (and NoSQL)
• 8. Spark Streaming
• 9. Spark MLLib

Datasets

• 1. Datasets