RRS-converter Go

!!! This project is archived in favor of S3BC !!!

This script allows you to simply convert storage class of the AWS S3 objects. More information about AWS S3 storage classes could be found here.

Script leverages AWS-sdk and some magic of goroutines to convert all objects in S3 bucket to the storage class you specify. If you want to convert only some of them, feel free to modify this script or use AWS CLI.

Build and install

Dependencies:

Installation:

Code is compatible with Go 1.11 and uses its Go Modules Installation:

Install Go 1.11 and do:

$ git clone https://github.com/grem11n/rrs-converter-go.git
$ go build rrs-converter.go

In order to get the version:

git clone https://github.com/grem11n/rrs-converter-go.git
git checkout <TAG_YOU_WANT_TO_USE>
VERSION=$(git tag -l --points-at HEAD)
COMMIT=$(git rev-parse --short HEAD)
go build -ldflags "-X main.ver=${VERSION} -X main.commit=${COMMIT}"

If the version is not specified i.e you are not using a stable tag, output for version will be Onbuild

Usage

Required Parameters

You must specify which bucket to convert with -bucket flag. This is the only parameter, which is strictly required

Optional Parameters:

-config - custom config location. I've never tried it with relative path. It could probably works, who knows. If not declared, AWS-sdk use your ~/.aws/credentials file by default.
-region - bucket location. Script will use us-east-1 by default.
-section specifies which section of your AWS configuration file to use. If not specified, use "[default]".
-maxcon - number of maximum concurrent goroutines. 10 by default.
-type - specifies target AWS storage class, STANDARD by default.

Sample Usage

rrs-converter -bucket=my-bucket -config="/home/user/.aws/credentials" -region=eu-west-1 -section=test -maxcon=5 -type="reduced_redundancy"