Fails when filesize is too large

Question

Fails when filesize is too large

Opened this issue 5 years ago · 1 comments

I am using the Cassandra Cain tool (https://github.com/maorfr/cain) to backup a Cassandra datacenter and it is failing when backing up files which are 500 GB in size.

Having looked at the code for this project, I've noticed that this project is using the default UploadPartSize of 5 megabytes (https://github.com/aws/aws-sdk-go/blob/fe72a52350a8962175bb71c531ec9724ce48abd8/service/s3/s3manager/upload.go#L26), this gives us the ability to files up to 52 GB in size.

Please can you consider increasing this value to 64 bytes so SKBN is able to upload files up to 671 GB in size?

Answer 1 · 2020-05-18T06:56:11.000Z

Hi @ButlerJoseph
When you say it is failing - did the process fail with an error message or just hangs? What error did you see?