Coder-World04/Complete-Data-Engineering

This repository contains everything you need to become proficient in Data Engineering

MIT

Complete Data Engineering with Projects Series

This repository contains everything you need to become proficient in Data Engineering .

Pic credits: infra

Youtube for all the implemented projects and tech interview resources - Ignito Youtube Channel

Complete Cheat Sheet for Tech Interviews - How to prepare efficiently

I took theses Projects Based Courses to Build Industry aligned Data Science and ML skills

Part 1 - How to solve Any ML System Design Problem

Pre-requisite : Day 1 — Day 60 : Quick Recap of 60 days of Data Science and ML

Data Engineering

What's Data Engineering

Why Data Engineering

Data Engineers - ML Engineers -- Data Scientists

Purpose and Scope

Python for Data Engineering

Basic Python with Project

Advanced Python with Project

Techniques to write efficient and optimized code

SQL Basics

Structured Query Language

Query Structure

Stored Procedures

Aggregations

Aggregation Functions

Group By, Order By

Write Sub queries

Analytical Functions

Window Functions

Advanced windowing techniques

BigQuery

BigQuery Basics

SELECT, FROM, WHERE and Date and Extract in BigQuery

Common Expression Table

SQL vs NoSQL Database

Advanced Functions

Performance Tuning SQL Queries

Query Optimizations in SQL

MySQL, PostgreSQL and MongoDB

Introduction to MySQL

Introduction to PostgreSQL

Introduction to Mongo DB

Comparison between MySQL and PostgreSQL and Mongo DB

Introduction to SQL and NoSQL Databases

Scripting and Automation

Shell Scripting

ETL ( Extract, Tranform and Load) basics

Why ETL is important?

Relational Databases and SQL

NoSQL Data bases and Map Reduce

Data Warehouses

Structured Data

Semi Structured Data

Unstructured Data

13.Data Analysis

Advanced Pandas Techniques

Data Pre-processing

Handling missing values

Mean/mode/median Imputation

Hot Deck Imputation

Regression Imputation

Stochastic regression imputation

Feature Scaling

Data Augmentation

Read and Process Large Datasets

Data Visualization basics

Data Visualization Projects

Data Visualization using Plotly and Bokeh

Summary Functions

Linear Regression

Multi Linear Regression

Polynomial Regression

Support Vector Regression

Decision Tree Regression

Random Forest Regression

Feature Engineering

GroupBy Features

Categorical and Numerical Features

Missing Value Analysis

Fill the missing Values

Unique Value Analysis

Univariate Analysis

Bivariate Analysis

Multivariate Analysis

Correlation Analysis

Spearman’s ρ

Cramér’s V (φc)

Data Processing Techniques

Batch Processing

Stream Processing

Apache Spark Commands

How Apache Kafka works

Big Data

Types of Big Data

SQL and NoSQL Databases

Data Pipelines and WorkFlows

Infrastructure

Docker vs Virtual Machines

Most important Docker commands

Power BI

Which chart to use and When?

Power BI — Data Analysis Expressions

Cloud Data Engineering

Data Engineering on cloud

Google Cloud Platform

Google Cloud Platform services

Machine Learning Algorithms

Linear Regression

Logistic Regression

Support Vector Machines

K Nearest Neighbors

K means Clustering

Hierarchical Clustering

Neural Networks

Some of the other best Series-

Complete 60 Days of Data Science and Machine Learning Series

30 days of Machine Learning Ops

30 Days of Natural Language Processing ( NLP) Series

Data Science and Machine Learning Research ( papers) Simplified **

30 days of Data Engineering with projects Series

60 days of Data Science and ML Series with projects

100 days : Your Data Science and Machine Learning Degree Series with projects

23 Data Science Techniques You Should Know

Tech Interview Series — Curated List of coding questions

Complete System Design with most popular Questions Series

Complete Data Visualization and Pre-processing Series with projects

Complete Python Series with Projects

Complete Advanced Python Series with Projects

Kaggle Best Notebooks that will teach you the most

Complete Developers Guide to Git

Exceptional Github Repos — Part 1

Exceptional Github Repos — Part 2

All the Data Science and Machine Learning Resources

210 Machine Learning Projects

6 Highly Recommended Data Science and Machine Learning Courses that you MUST take ( with certificate) -

Complete Data Scientist : https://bit.ly/3wiIo8u

Learn to run data pipelines, design experiments, build recommendation systems, and deploy solutions to the cloud.

Complete Data Engineering : https://bit.ly/3A9oVs5

Learn to design data models, build data warehouses and data lakes, automate data pipelines, and work with massive datasets

Complete Machine Learning Engineer : https://bit.ly/3Tir8ub

Learn advanced machine learning techniques and algorithms - including how to package and deploy your models to a production environment.

Complete Data Product Manager : https://bit.ly/3QGUtwi

Leverage data to build products that deliver the right experiences, to the right users, at the right time. Lead the development of data-driven products that position businesses to win in their market.

Complete Natural Language Processing : https://bit.ly/3T7J8qY

Build models on real data, and get hands-on experience with sentiment analysis, machine translation, and more.

Complete Deep Learning: https://bit.ly/3T5ppIo

Learn to implement Neural Networks using the deep learning framework PyTorch