Projects done during Upgrad BigData Engineer course
- SaavnProject - With basic functionality
- ETLBatchProject - ETL processing using sqoop, hive & mysql
- RealTimeProject - Spark and Storm streaming project
- SaavnAnalyticProject - SparkSql and ML (ALS and Kmeans Algorithm)
- TwitterClassification Project - SparkSql and ML (Random forest and Decision Tree Algorithm)
- CreditCardFraudDetection Project - Batch Layer (Hive), Real Time Layer (Spark Dstream), Sqoop for relational data ingestion and kafka for real time streaming data ingestion, Hbase for fast real time lookup.