/s3-bulk-delete

Empties an S3 bucket@3500 Objects per second

Primary LanguageGoOtherNOASSERTION



S3 Bulk Delete helps to empty s3 buckets
It is much faster than delete through aws-cli which is sequential

Submit an Issue

Gitter

What is this project for

  • Currently we can use aws cli to empty an s3 bucket. But is very slow because of the sequential nature
  • s3-bulk-delete uses list-objects(5,500 objects per second) and delete-objects(3500 objects per second per prefix) api using aws sdk to delete at much faster rate respecting aws s3 rate limit rules

Demo


How to use

  • Download the latest binary from the releases section depending on the target platform
  • Execute the download binary with desired flags
usage: ./s3-bulk-delete -aws-region {{region}} -bucket {{{bucketname}}

  -aws-region string
        AWS Region in which bucket exists. (Required)
  -bucket string
        Bucket name to be deleted. (Required)

Examples

s3-bulk-delete-windows.exe -aws-region us-east-1 -bucket test
./s3-bulk-delete-linux -aws-region us-east-1 -bucket test-bucket
./s3-bulk-delete-darwin -aws-region us-east-1 -bucket test-bucket

Future plans

  • Migrate the project to use go modules

How to contribute

Feel free to raise a PR with new features or fixing existing bugs

License

See the LICENSE file for license rights and limitations (Apache2.0).