Course Data Engineering Essentials Hands-on SQL, Python and Spark at Udemy
- Section 01 - Introduction About the Course
- Section 02 - Setting up Environment Using AWS Cloud9
- Section 03 - Setting up Environment - Overview of GCP and Provision Ubuntu VM
- Section 04 - Networking Concepts for Beginners - Ip Addresses and Port Numbers
- Section 05 - Setting up Environment - Setup Postgres Database on Ubuntu VM
- Section 06 - Database Essentials - Getting Started
- Section 07 - Database Essentials - Database Operations
- Section 08 - Database Essentials - Writing Basic SQL Queries
- Section 09 - Database Essentials - Creating Tables and Indexes
- Section 10 - Database Essentials - Partitioning Tables and Indexes
- Section 11 - Database Essentials - Predefined Functions
- Section 12 - Database Essentials - Writing Advanced SQL Queries
- Section 13 - Programming Essentials Using Python - Perform Database Operations
- Section 14 - Programming Essentials Using Python - Getting Started with Python
- Section 15 - Programming Essentials Using Python - Basic Programming Constructs
- Section 16 - Programming Essentials Using Python - Predefined Functions
- Section 17 - Programming Essentials Using Python - User Defined Functions
- Section 18 - Programming Essentials Using Python - Overview of Collections - List and Set
- Section 19 - Programming Essentials Using Python - Overview of Collections - Dict and Tuple
- Section 20 - Programming Essentials Using Python - Manipulating Collections using Loops
- Section 21 - Programming Essentials Using Python - Development of Map Reduce APIs
- Section 22 - Programming Essentials Using Python - Understanding Map Reduce Libraries
- Section 23 - Programming Essentials Using Python - Basics of File IO using Python
- Section 24 - Programming Essentials Using Python - Delimited Files and Collections
- Section 25 - Programming Essentials Using Python - Overview of Pandas Libraries
- Section 26 - Programming Essentials Using Python - Database Programming CRUD Operations
- Section 27 - Programming Essentials Using Python - Database Programming Bath Operation
- Section 28 - Programming Essentials Using Python - Processing JSON Data
- Section 29 - Programming Essentials Using Python - Processing REST Payloads
- Section 30 - Understanding Python Virtual Environments
- Section 31 - Overview of Pycharm for Python Application Development
- Section 32 - Data Copier - Getting Started
- Section 33 - Data Copier - Reading Data using Pandas
- Section 34 - Data Copier - Database Programming using Pandas
- Section 35 - Data Copier - Loading Data from Files to Tables
- Section 36 - Data Copier - Modularizing the Application
- Section 37 - Data Copier - Dockerizing the Application
- Section 38 - Data Copier - Using Custom Docker Image
- Section 39 - Data Copier - Deploy and Validate Application on Remote Server
- Section 40 - Setup Single Node Hadoop and Spark Cluster or Lab using Docker
- Section 41 - Introduction to Hadoop Eco System - Overview of HDFS
- Section 42 - Data Engineering using Spark SQL - Getting Started
- Section 43 - Data Engineering using Spark SQL - Basic Transformations
- Section 44 - Data Engineering using Spark SQL - Basic DDL and DML
- Section 45 - Data Engineering using Spark SQL - Managing Tables - DML and Partitioning
- Section 46 - Data Engineering using Spark SQL - Overview of Spark SQL Functions
- Section 47 - Data Engineering using Spark SQL -Windowing Functions
- Section 48 - Apache Spark using Python - Data Processing Overview
- Section 49 - Apache Spark using Python - Processing Column Data
- Section 50 - Apache Spark using Python - Basic Transformations
- Section 51 - Apache Spark using Python - Joining Data Sets
- Section 52 - Apache Spark using Python - Spark Metastore
- Section 53 - Apache Spark - Development Life Cycle using Python
- Section 54 - Spark Application Execution Life Cycle and Spark UI
- Section 55 - Setup SSH Proxy to Access Spark Application Logs
Link to the course: Udemy