Terraform module for creating Kinesis Applications

Creates:

A kinesis stream
An S3 bucket for backing up events
Optionally A kinesis firehose to S3 for backing up every record
Optionally A lambda to copy from the stream to the firehose
Cloudwatch error logging for the firehose
All applicable IAM roles and policies, including a read-only role for KCL applications
(Optionally) an APIKey secured API gateway for posting to the stream from outside AWS (e.g. GAE)

Supports:

backup to an s3 bucket via lambda -> firehose
optional API Gateway endpoints for writing to the stream

Example usage

terraform.tf

variable aws_access_key {
  type = "string"
}

variable aws_secret_key {
  type = "string"
}

variable aws_region {
  type    = "string"
  default = "us-east-1"
}

aws.tf

provider "aws" {
  access_key = "${var.aws_access_key}"
  secret_key = "${var.aws_secret_key}"
  region     = "${var.aws_region}"
}

main.tf

module "kinesis_tf" {
  source = "github.com/udacity/kinesis_tf"

  stream_name        = "example1"
  retention_period   = "48"
  environment_name   = "production"
  application_name   = "RegistrarTermImporter"
  aws_region         = "${var.aws_region}"
  create_api_gateway = true
  create_s3_backup = false
}

To get the module from github:

terraform get

kevbuchanan/kinesis_tf

Terraform module for creating Kinesis Applications

Example usage