Big Data Journal Projects
This Projects are done under Cloud Tech and BigdataJournal Community Group
Vadodara
Pinned Repositories
Amazon-Redshift-cluster-to-analyze-USA-Domestic-flight-data
worked with an Amazon Redshift cluster to analyze USA Domestic flight data. Amazon Redshift is a fast, fully managed, petabyte-scale data warehouse service that makes it simple and cost-effective to efficiently analyze all your data using your existing business intelligence tools. It is optimized for datasets ranging from a few hundred gigabytes to a petabyte or more and costs less than $1,000 per terabyte per year, a tenth the cost of most traditional data warehousing solutions
Analysing-Census-Data-using-aws
Use aws-emr and aws-redshift to analyse dataset of adult census of USA
Analyzing-Twitter-in-real-time-with-Kinesis-Lambda-Comprehend-and-ElasticSearch
Analyzing Twitter in real time with Kinesis, Lambda, Comprehend and ElasticSearch
AWS-Data-Lake
AWS Lake Formation makes it easy for you to set up, secure, and manage your data lakes also data discovery using the metadata search capabilities of Lake Formation in the console, and metadata search results restricted by column permissions.
aws-forest-fire-predictive-analytics
Big Data Engineering & Analytics Project
aws-serverless-data-lake-workshop
This workshop is meant to give customers a hands-on experience with mentioned AWS services. Serverless Data Lake workshop helps customers build a cloud-native and future-proof serverless data lake architecture. It allows hands-on time with AWS big data and analytics services including Amazon Kinesis Services for streaming data ingestion
big-data-ecosystem
Project developed during the Cognizant Cloud Data Engineer Bootcamp on the Digital Innovation One platform with the objective of extracting and counting words from a book in plain text format, displaying the most frequent word, through a python algorithm.
big-data-solutions
This repository provides Code examples written in Python,Spark-Scala using primarily boto3 SDK API methods and aws cli examples for majority of the AWS Big Data services. There are also nicley written Wiki articles for most of the common issues/challenges faced within BigData world.
Iot-and-Big-Data-Application-using-aws-and-apache-kafka
Iot,Big Data Analytics using Apache-kafka,spark and other aws services
IoT-Data-with-Amazon-Kinesis
Build a Visualization and Monitoring Dashboard for IoT Data with Amazon Kinesis Analytics and Amazon QuickSight
Big Data Journal Projects's Repositories
AWS-Big-Data-Projects/aws-forest-fire-predictive-analytics
Big Data Engineering & Analytics Project
AWS-Big-Data-Projects/AWS-Data-Lake
AWS Lake Formation makes it easy for you to set up, secure, and manage your data lakes also data discovery using the metadata search capabilities of Lake Formation in the console, and metadata search results restricted by column permissions.
AWS-Big-Data-Projects/Iot-and-Big-Data-Application-using-aws-and-apache-kafka
Iot,Big Data Analytics using Apache-kafka,spark and other aws services
AWS-Big-Data-Projects/Analyzing-Twitter-in-real-time-with-Kinesis-Lambda-Comprehend-and-ElasticSearch
Analyzing Twitter in real time with Kinesis, Lambda, Comprehend and ElasticSearch
AWS-Big-Data-Projects/Analysing-Census-Data-using-aws
Use aws-emr and aws-redshift to analyse dataset of adult census of USA
AWS-Big-Data-Projects/AWS-EMR
Analyzing Big Data with Amazon EMR
AWS-Big-Data-Projects/aws-serverless-data-lake-workshop
This workshop is meant to give customers a hands-on experience with mentioned AWS services. Serverless Data Lake workshop helps customers build a cloud-native and future-proof serverless data lake architecture. It allows hands-on time with AWS big data and analytics services including Amazon Kinesis Services for streaming data ingestion
AWS-Big-Data-Projects/front-line-concussion-monitoring-system-using-AWS-IoT-and-serverless-data-lakes
A simple, practical, and affordable system for measuring head trauma within the sports environment, subject to the absence of trained medical personnel made using Amazon Kinesis Data Streams, Kinesis Data Analytics, Kinesis Data Firehose, and AWS Lambda
AWS-Big-Data-Projects/IoT-Data-with-Amazon-Kinesis
Build a Visualization and Monitoring Dashboard for IoT Data with Amazon Kinesis Analytics and Amazon QuickSight
AWS-Big-Data-Projects/Run-a-Spark-job-within-Amazon-EMR
Run a Spark job within Amazon EMR
AWS-Big-Data-Projects/Log-Analytics-Solution-With-AWS
Collect, process, and analyze log data using Amazon Kinesis and Elasticsearch Service
AWS-Big-Data-Projects/amazon-kinesis-data-processor-aws-fargate
Sample code for the AWS Big Data Blog Post Building a scalable streaming data processor with Amazon Kinesis on AWS Fargate
AWS-Big-Data-Projects/awesome-aws
A curated list of awesome Amazon Web Services (AWS) libraries, open source repos, guides, blogs, and other resources. Featuring the Fiery Meter of AWSome.
AWS-Big-Data-Projects/aws-big-data-blog
AWS-Big-Data-Projects/big-data
Project, assignments & research related to Hadoop Ecosytem
AWS-Big-Data-Projects/bigdata-playground
A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL
AWS-Big-Data-Projects/emr-bootstrap-actions
This repository hold the Amazon Elastic MapReduce sample bootstrap actions
AWS-Big-Data-Projects/ferry
Ferry lets you define, run, and deploy big data applications on AWS, OpenStack, and your local machine using Docker
AWS-Big-Data-Projects/serverless-data-pipeline-sam
Serverless Data Pipeline powered by Kinesis Firehose, API Gateway, Lambda, S3, and Athena
AWS-Big-Data-Projects/workshop-aws-iot
Repository for AWS Workshop on IoT. Control and collect data from a swarm of IoT devices simulated locally.