/Cloud_Computing_Capstone_Project

This Repository Contains collection of Minor and Major cloud computing project on AWS, Azure, GCP

Cloud_Computing_Capstone_Project

This Repository Contains collection of Minor and Major cloud computing project on AWS, Azure, GCP

Project 1 - JSON TO CSV Iin shifting Blob1 to Blob 2 and create matrics

🎯 we have data in json format which store into blob file and we need to convert this json to json to csv format and store in 
output folder we will mount owner data bricks to output container perform some basic data cleaning operation and convert intoproper 
reporting format and finally we will derive business metrics with the help of power bi

Services used -

  • S3 Bucket
  • Storage Account
  • container (blob)
  • Azure data factory
  • Data bricks
  • Azure Data pipeline
  • power bi (no an cloud service)

Scope / Future step - next step to increace data source and make automation, try to use azure synapse analytics

Project 2 - S3 TO Blob & Mount Data Bricks

🎯 we have business use case  data is comming to the amazon s3 bucket location in amazon S3 location. 
from external resource suppose data from system generated. we want to do move the data from amazon s3 bucket 
to blob storage and mount on data bricks.

Services used -

  • Storage Account
  • container (blob)
  • Azure data factory
  • Data bricks
  • Azure Data pipeline

Scope / Future step - next step to increace data sources and make automation

Project 3 - Data transformation and data pipe line

🎯 In this project we have data which is store into blob and we need to transform our data and store into blob storage again

Old infra.

Services used -

  • Blob storage
  • Azure Data Factory
  • Azure Data flow
  • Azure Data pipeline

Scope / Future step - project is on going at intial stage

Project 4 - Modernizating Local resources using AWS IAAS (lift and shift Strategie)

*** project is on going at very intial stage (given project is an just concept)*

🎯 Applicating servicing running on physical or VM Machine on local data center such as mysql,DNS,Tomcat,Nginx,shared storage etc.
solution - we are going to provide this automation and modernized using aws , scalebale, no upfront cost.

Old infra.

Services used -

  • EC2 Instance
  • ELB
  • Route 53
  • S3
  • Autoscaling

Scope / Future step - project is on going at intial stage.