Vaishaal/numpywren

integration with zarr?

Opened this issue · 0 comments

This library seems very cool and probably underutilized. Thanks for continuing to maintain it.

I am a core dev for Zarr , a cloud-friendly array storage library. I was wondering if you had thought about integration with the Zarr storage model. Zarr's data model seems very compatible with that of numpywren. We have lots of Zarr data on S3, and it would be awesome to be able to compute on it easily in a serverless way. By browsing the code, it wasn't immediately clear to me where something like this would plug in.

If I or any of the other zarr devs could help on this, please let me know.