mehdi-lamrani/spark-databricks

Apache Spark Programming with Databricks

Course Agenda

Day 1

Introductions

• 1.1 - Databricks Platform
• 1.1L - Explore Datasets Lab

Spark Core

• 2.1 - Spark SQL
• 2.1L - Spark SQL Lab
• 2.2 - Reader & Writer
• 2.2L - Ingesting Data Lab
• 2.3 - DataFrame & Column
• 2.3L - Purchase Revenues Lab

Day 2

Spark SQL

• Capstone - Spark SQL - Airlines Analytics

Functions

• 3.1 - Aggregation
• 3.1L - Revenue by Traffic Lab
• 3.2 - Datetimes
• 3.2L - Active Users Lab
• 3.3 - Complex Types

Optional :

• 3.3L - Users
• 3.4 - Additional Functions
• 3.4L - Abandoned Carts Lab
• 3.5 - UDFs
• 3.5L - Sort Day Lab

Day 3

Streaming

• 4.1 - Streaming Query
• 4.1aL - Coupon Sales Lab
• 4.1bL - Hourly Activity by Traffic Lab
• 4.1cL - Activity by Traffic Lab
• Capstone - Spark Streaming - Financial Alpha Stream

Optional

Delta Lake

• 5.1 - Delta Lake
• 5.1L - Delta Lake Lab

Optional

Performance

• 6.1 - Query Optimization
• 6.2 - Partitioning
• 6.2L - De-Duping Data Lab