iLearnDE
Hi, welcome to this amazing resources here. A stepwise collection of topics for learning DATA ENGINEERING. It is divided into three folders and three task-levels.
Prerequisites
To get most out of this course you just need to get an DE. Prior experience is not needed. All the materials of the course are freely available, so you can replicate them easily
Tools
For this course you'll need to have any of the following relational database management systems software installed on your computer.
- EXCEL (via Link)
- MSSQL (via Link)
- MYSQL (via Link)
- MONGODB (via Link)
- POSTGRESQL(via Link)
- AIRFLOW (via Link)
- KAFKA (via Link)
- POWERBI (via Link)
- PYSPARK (via Link)
- PYTHON (via Link)
Learning Format
- level 0: Data Pipeline & ETL
- level 1: Data Scheduling & ETL
- leek 2: Data Scraping & Cloud Integrations
Syllabus
Level 0: Data Pipeline & ETL
- ELT-PIPELINE-I-MSSQL-TO-MYSQL
- ELT-PIPELINE-II-MSSQL-TO-PSQL
- ELT-PIPELINE-III-MONGODB-TO-
- ELT-PIPELINE-IV-
- ELT-PIPELINE-V-
Level 1: Data Scheduling & ETL
- ETL-SCHEDULING-DB-I
- ETL-SCHEDULING-DB-II
- ETL-SCHEDULING-DB-III
- ETL-SCHEDULING-DB-IV
- ETL-SCHEDULING-DB-V
Level 2: Data Scraping & Cloud Integrations
- ETL-WEBSCRAPING-API-I
- ETL-WEBSCRAPING-API-II
- ETL-WEBSCRAPING-API-III
- ETL-WEBSCRAPING-API-IV
- ETL-WEBSCRAPING-API-V
FAQ
When Asking for Help Online
The fatest way to get a self-explanatory answer might be to use CHAT-GPT3.
Start using the tool using CHATGPT-3
channel.
- Follow these recommendations when asking for help from Stackeoverflow
- Follow these recommendations when asking for help from Reddit
- Follow these recommendations when asking for help from Twitter
- Follow these recommendations when asking for help from Online forumns
References
Documentations
- The EXCEL DOCS
- The MSSQL DOCS
- The MYSQL DOCS
- The POSTGRESQL DOCS
- The MONGODB DOCS
- The AIRLOW DOCS
- The KAFKA DOCS
- The POWERBI DOCS
- The PYTHON DOCS
- The PYSPARK DOCS
Books
- xxxx (https://linkedin.com/in/xxxxx)
- Sejal Vaidya (https://linkedin.com/in/vaidyasejal)
Communities
- xxxx (https://linkedin.com/in/xxxxx)
- Sejal Vaidya (https://linkedin.com/in/vaidyasejal)
- xxxx (https://linkedin.com/in/xxxxx)
- Sejal Vaidya (https://linkedin.com/in/vaidyasejal)
- xxxx (https://linkedin.com/in/xxxxx)
Webistes
- xxxx (https://linkedin.com/in/xxxxx)
- Sejal Vaidya (https://linkedin.com/in/vaidyasejal)
- xxxx (https://linkedin.com/in/xxxxx)
- Sejal Vaidya (https://linkedin.com/in/vaidyasejal)
- xxxx (https://linkedin.com/in/xxxxx)
- Sejal Vaidya (https://linkedin.com/in/vaidyasejal)
- xxxx (https://linkedin.com/in/xxxxx)
- Sejal Vaidya (https://linkedin.com/in/vaidyasejal)
- xxxx (https://linkedin.com/in/xxxxx)
- Sejal Vaidya (https://linkedin.com/in/vaidyasejal)
Persons
- xxxx (https://linkedin.com/in/xxxxx)
- Sejal Vaidya (https://linkedin.com/in/vaidyasejal)
- xxxx (https://linkedin.com/in/xxxxx)
- Sejal Vaidya (https://linkedin.com/in/vaidyasejal)
- xxxx (https://linkedin.com/in/xxxxx)
- Sejal Vaidya (https://linkedin.com/in/vaidyasejal)
- xxxx (https://linkedin.com/in/xxxxx)
- Sejal Vaidya (https://linkedin.com/in/vaidyasejal)
- xxxx (https://linkedin.com/in/xxxxx)
- Sejal Vaidya (https://linkedin.com/in/vaidyasejal)