Pinned Repositories
About-Me
Data Analyst || BI Analyst || Spreadsheets || SQL/Python/R || Tableau || Power BI || DBA
Amazon-Product-Sales
This is an Exploratory Data Analysis done on the Amazon Product Sales dataset from kaggle.
Assignment-on-Data-Scraping
Analyzing Historical Stock/Revenue Data and Building a Dashboard for my IBM Data Analyst Certificate Programme
Automobile-Data
This is an Exploratory Data Analysis done on an Automobile dataset from kaggle
City-Weather-and-S3File-RDS-S3-BigQuery-ETL-by-Airflow-on-EC2
This is my third AWS Cloud ETL project. This data pipeline orchestration uses Apache Airflow on AWS EC2. It demonstrates how to build an ETL data pipeline that would perform data extraction to a database in parallel to a loading process into the same database, join the tables, copy joined data to S3 and finally copy the S3 file to BigQuery DW.
Customer-Churn-Data-Analytics-ETL-Pipeline-by-Airflow-on-EC2
This is an end-to-end AWS Cloud ETL project. This orchestration uses Apache Airflow on AWS EC2 as well as AWS Glue. It demonstrates how to build ETL pipeline that would perform data transform using Glue job/crawler as well as loading into a Redshift table. It also shows how to connect Amazon Athena to Glue Data Catalog, and Power BI to Redshift.
Redfin-Analytics-ETL-Data-Engg-Pipeline-by-Airflow-on-EC2
This is an end-to-end AWS Cloud ETL project. This data pipeline orchestration uses Apache Airflow on AWS EC2 as well as Snowpipe. It demonstrates how to build ETL data pipeline that would perform data transformation using Python on Apache Airflow as well as automatic ingestion into Snowflake data warehouse via Snowpipe. Also features Power BI.
Redfin-Analytics-ETL-using-Amazon-EMR-by-Airflow-on-EC2
This is an end-to-end AWS Cloud ETL project. This data pipeline uses an Amazon EMR cluster managed by Apache Airflow that is running on an AWS EC2 instance. It demonstrates how to build orchestration that would perform data transformation using Amazon EMR as well as automatic data ingestion into a Snowflake via Snowpipe. It also features Power BI.
Water-Quality-DW-on-SQL-Server
This is an MSSQL Data Warehouse and manual ETL demo on a specially formatted Water Quality dataset from DEFRA, UK. It is a personal academic-grade exercise to explore the basic concepts of data warehousing and manual ETL process from an academic perspective.
Zillow-Rapid-API-end-to-end-ETL-data-pipeline-by-Airflow-on-EC2
This is an end-to-end AWS Cloud ETL project. This data pipeline orchestration uses Apache Airflow on AWS EC2 as well as AWS Lambda. It demonstrates how to build ETL data pipeline that would perform data transformation using Lambda function as well as loading into a Redshift cluster table. The data would then be visualized using Amazon QuickSight.
vaxdata22's Repositories
vaxdata22/Water-Quality-DW-on-SQL-Server
This is an MSSQL Data Warehouse and manual ETL demo on a specially formatted Water Quality dataset from DEFRA, UK. It is a personal academic-grade exercise to explore the basic concepts of data warehousing and manual ETL process from an academic perspective.
vaxdata22/About-Me
Data Analyst || BI Analyst || Spreadsheets || SQL/Python/R || Tableau || Power BI || DBA
vaxdata22/Amazon-Product-Sales
This is an Exploratory Data Analysis done on the Amazon Product Sales dataset from kaggle.
vaxdata22/Assignment-on-Data-Scraping
Analyzing Historical Stock/Revenue Data and Building a Dashboard for my IBM Data Analyst Certificate Programme
vaxdata22/Automobile-Data
This is an Exploratory Data Analysis done on an Automobile dataset from kaggle
vaxdata22/Cities-Weather-S3-Snowflake-Slack-notif-ETL-by-Airflow-on-EC2
This is my second AWS Cloud ETL project. This data pipeline orchestration uses Apache Airflow on AWS EC2. It demonstrates how to build an ETL data pipeline that would extract data (JSON) from the OpenWeatherMap API, transform it, dump it as CSV in S3 bucket, then copy it to destination tables in Snowflake DW and send Slack notification.
vaxdata22/City-Weather-and-S3File-RDS-S3-BigQuery-ETL-by-Airflow-on-EC2
This is my third AWS Cloud ETL project. This data pipeline orchestration uses Apache Airflow on AWS EC2. It demonstrates how to build an ETL data pipeline that would perform data extraction to a database in parallel to a loading process into the same database, join the tables, copy joined data to S3 and finally copy the S3 file to BigQuery DW.
vaxdata22/Countries-Population
This is an Exploratory Data Analysis done on a Countries dataset from kaggle
vaxdata22/Customer-Churn-Data-Analytics-ETL-Pipeline-by-Airflow-on-EC2
This is an end-to-end AWS Cloud ETL project. This orchestration uses Apache Airflow on AWS EC2 as well as AWS Glue. It demonstrates how to build ETL pipeline that would perform data transform using Glue job/crawler as well as loading into a Redshift table. It also shows how to connect Amazon Athena to Glue Data Catalog, and Power BI to Redshift.
vaxdata22/Cyclistic-Ride-Sharing-Company
This is my Google Data Analytics Certificate case study for the Cyclistic ride-sharing company
vaxdata22/Foresight-Institution
This is a Data Analysis case study done on the Foresight Institution dataset.
vaxdata22/Foresight-Pharmaceutical
This is a Data Analysis case study done on the Foresight Pharmaceutical Company dataset.
vaxdata22/Istanbul-Shopping
This is an Exploratory Data Analysis done on Istanbul Shopping dataset from kaggle.
vaxdata22/Lagos-Weather-S3-Snowflake-Email-notif-ETL-by-Airflow-on-EC2
This is my first ever AWS Could ETL project. This data pipeline orchestration uses Apache Airflow on AWS EC2. It demonstrates how to build an ETL data pipeline that would extract data (JSON) from the OpenWeatherMap API, transform it, dump it as CSV in S3 bucket, then copy it to a destination table in Snowflake DW and send email notification.
vaxdata22/NoSQL-and-Big-Data-demonstration
This is a fun assignment task I undertook to explore the world of NoSQL and Big Data. technologies.
vaxdata22/Redfin-Analytics-ETL-Data-Engg-Pipeline-by-Airflow-on-EC2
This is an end-to-end AWS Cloud ETL project. This data pipeline orchestration uses Apache Airflow on AWS EC2 as well as Snowpipe. It demonstrates how to build ETL data pipeline that would perform data transformation using Python on Apache Airflow as well as automatic ingestion into Snowflake data warehouse via Snowpipe. Also features Power BI.
vaxdata22/Redfin-Analytics-ETL-using-Amazon-EMR-by-Airflow-on-EC2
This is an end-to-end AWS Cloud ETL project. This data pipeline uses an Amazon EMR cluster managed by Apache Airflow that is running on an AWS EC2 instance. It demonstrates how to build orchestration that would perform data transformation using Amazon EMR as well as automatic data ingestion into a Snowflake via Snowpipe. It also features Power BI.
vaxdata22/Salifort-Motors-and-Waze-Churn
Employee retention predictive model development for Salifort Motors and Waze. This is a terminal project I did to earn the Google Advanced Data Analytics Professional Certificate.
vaxdata22/Water-Quality-DW-on-Oracle-Database
This is an Oracle DB Data Warehouse and manual ETL demo on a specially formatted Water Quality dataset from DEFRA, UK. It is a personal academic-grade exercise to explore the basic concepts of data warehousing and manual ETL process from an academic perspective.
vaxdata22/Zillow-Rapid-API-end-to-end-ETL-data-pipeline-by-Airflow-on-EC2
This is an end-to-end AWS Cloud ETL project. This data pipeline orchestration uses Apache Airflow on AWS EC2 as well as AWS Lambda. It demonstrates how to build ETL data pipeline that would perform data transformation using Lambda function as well as loading into a Redshift cluster table. The data would then be visualized using Amazon QuickSight.
vaxdata22/Image-Background-Remover-demo-with-Python
This is a simple but fun exercise that was done to demonstrate the power of Python in image manipulation using libraries like Pillow (PIL) and Rembg as well as leveraging ONNX Runtime for faster processing on GPU.
vaxdata22/little-lemon-booking-system-db
Database project for managing the table booking system of the Little Lemon restaurant. This is a capstone project I undertook in order to earn the Meta Database Engineer Professional Certificate credential.