ome/ome-zarr-py

Read data from protected s3?

BioinfoTongLI opened this issue · 2 comments

BioinfoTongLI commented

Hello there!

I am just wondering is it possible to parse s3 data which requires accessKey/secretKey?
I believe the error below is just a permission issue?

reader = Reader(parse_url("https://cog.sanger.ac.uk/webatlas/deleteme/raw_image/0/"))
[ERROR] 403, message='Forbidden', url=URL('https://cog.sanger.ac.uk/webatlas/deleteme/raw_image/0/.zgroup')

I couldn't find documentation about how to provide those keys to the parser.
Is it possible at all?

Best,
Tong

joshmoore commented

I don't have a working example for HTTP access to private s3, but the fsspec code that's used should be able to connect. Configuration instructions are at https://filesystem-spec.readthedocs.io/en/latest/features.html#configuration

You can see my use of it here: fsspec/s3fs#273 (comment)

  • 👍1
joshmoore commented

@BioinfoTongLI : closing for now. Let us know if you are still having problems.