sqs-broker is no longer actively maintained by VMware.

AWS SQS Service Broker

This is an experimental Cloud Foundry Service Broker for Amazon Simple Queue Service (SQS).

Disclaimer

This is NOT presently a production ready Service Broker. This is a work in progress. It is suitable for experimentation and may not become supported in the future.

Installation

Locally

Using the standard go install (you must have Go already installed in your local machine):

$ go install github.com/cf-platform-eng/sqs-broker
$ sqs-broker -port=3000 -config=<path-to-your-config-file>

Cloud Foundry

The broker can be deployed to an already existing Cloud Foundry installation:

$ git clone https://github.com/cf-platform-eng/sqs-broker.git
$ cd sqs-broker

Modify the included manifest file to include your AWS credentials and optionally the sample configuration file. Then you can push the broker to your Cloud Foundry environment:

$ cp config-sample.json config.json
$ cf push sqs-broker

Docker

If you want to run the AWS SQS Service Broker on a Docker container, you can use the cfplatformeng/sqs-broker Docker image.

$ docker run -d --name sqs-broker -p 3000:3000 \
  -e AWS_ACCESS_KEY_ID=<your-aws-access-key-id> \
  -e AWS_SECRET_ACCESS_KEY=<your-aws-secret-access-key> \
  cfplatformeng/sqs-broker

The Docker image cames with an embedded sample configuration file. If you want to override it, you can create the Docker image with you custom configuration file by running:

$ git clone https://github.com/cf-platform-eng/sqs-broker.git
$ cd sqs-broker
$ bin/build-docker-image

BOSH

This broker can be deployed using the AWS Service Broker BOSH Release.

Configuration

Refer to the Configuration instructions for details about configuring this broker.

This broker gets the AWS credentials from the environment variables AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY. It requires a user with some IAM & SQS permissions. Refer to the iam_policy.json file to check what actions the user must be allowed to perform.

Usage

Managing Service Broker

Configure and deploy the broker using one of the above methods. Then:

Check that your Cloud Foundry installation supports Service Broker API Version v2.6 or greater
Register the broker within your Cloud Foundry installation;
Make Services and Plans public;
Depending on your Cloud Foundry settings, you migh also need to create/bind an Application Security Group to allow access to the SQS Queues.

Integrating Service Instances with Applications

Application Developers can start to consume the services using the standard CF CLI commands.

Depending on the broker configuration, Application Depevelopers can send arbitrary parameters on certain broker calls:

Provision

Provision calls support the following optional arbitrary parameters:

Option	Type	Description
delay_seconds	String	The time in seconds that the delivery of all messages in the queue will be delayed
maximum_message_size	String	The limit of how many bytes a message can contain before Amazon SQS rejects it
message_retention_period	String	The number of seconds Amazon SQS retains a message
receive_message_wait_time_seconds	String	The time for which a ReceiveMessage call will wait for a message to arrive
visibility_timeout	String	The visibility timeout for the queue

Refer to the Amazon Simple Queue Service Documentation for more details about how to set these properties

Update

Update calls support the following optional arbitrary parameters:

Option	Type	Description
delay_seconds	String	The time in seconds that the delivery of all messages in the queue will be delayed
maximum_message_size	String	The limit of how many bytes a message can contain before Amazon SQS rejects it
message_retention_period	String	The number of seconds Amazon SQS retains a message
receive_message_wait_time_seconds	String	The time for which a ReceiveMessage call will wait for a message to arrive
visibility_timeout	String	The visibility timeout for the queue

Refer to the Amazon Simple Queue Service Documentation for more details about how to set these properties

Contributing

In the spirit of free software, everyone is encouraged to help improve this project.

Here are some ways you can contribute:

by using alpha, beta, and prerelease versions
by reporting bugs
by suggesting new features
by writing or editing documentation
by writing specifications
by writing code (no patch is too small: fix typos, add comments, clean up inconsistent whitespace)
by refactoring code
by closing issues
by reviewing patches

Submitting an Issue

We use the GitHub issue tracker to track bugs and features. Before submitting a bug report or feature request, check to make sure it hasn't already been submitted. You can indicate support for an existing issue by voting it up. When submitting a bug report, please include a Gist that includes a stack trace and any details that may be necessary to reproduce the bug, including your Golang version and operating system. Ideally, a bug report should include a pull request with failing specs.

Submitting a Pull Request

Fork the project.
Create a topic branch.
Implement your feature or bug fix.
Commit and push your changes.
Submit a pull request.

vmware-archive/sqs-broker