The main purpose of this application is to help the data analytics team. The data analytics team collects data from s3 and does their analysis. This serverless application will do that, a client application produces data and pass data into the AWS kinesis data stream. after a certain buffer time or size, the AWS Data Firehose starts execution. During, Firehose execution lambda lambda will trigger for data transformation and store it in s3 for further work.
https://medium.com/@rafat97/kinesis-data-stream-kinesis-firehose-common-use-case-d515c785e51
-
Install serverless freamwork
npm install -g serverless -
Clone the repository
git clone https://github.com/Rafat97/aws-kinesis-data-stream-lambda-s3.git -
install packages
npm install -
Deploy application into AWS
npm run deploy:dev:us-west-1 -
After complition run producer for producing messages.
npm run run:producer -
[NOTE] If you want to remove application
npm run remove:dev:us-west-1 -
For more commend you can checkout
package.jsonfile.