Error when copying the whole dataset via aws s3 cli

Question

Error when copying the whole dataset via aws s3 cli

Closed this issue 7 months ago · 7 comments

I've been trying to download the whole dataset to see how it's partitnioned but I'm getting this error
fatal error: An error occurred (AccessDenied) when calling the ListObjectsV2 operation: Access Denied

when using

aws s3 cp --region us-west-2 --no-sign-request --recursive s3://overturemaps-us-west-2/release/2023-10-19-alpha.0/ .

Should it also be possible to use aws s3 ls on the dataset?

Thanks

Answer 1 · 2023-10-20T21:09:04.000Z

Does aws --no-sign-request s3 cp ... work?

Answer 2 · 2023-10-20T21:55:48.000Z

Not for me. Permissions issue with the bucket maybe.

Answer 3 · 2023-10-20T22:48:15.000Z

aws --no-sign-request s3 ls s3://overturemaps-us-west-2/release/2023-10-19-alpha.0/ does not work for you?

Or is it just cp that doesn't work?

Answer 4 · 2023-10-20T23:22:18.000Z

@mojodna Any thoughts?

Answer 5 · 2023-10-21T07:22:30.000Z

Ok, so it appears to be working (both cp & ls) on a remote Ec2 instance but not on my laptop.

Where I'm seeing An error occurred (AccessDenied) when calling the ListObjectsV2 operation: Access Denied

Answer 6 · 2023-11-20T21:00:41.000Z

@mtravis Did this get resolved? Okay to close?

Answer 7 · 2023-11-21T15:37:44.000Z

@jwass this seems to be working now thanks.