google/xarray-beam

Race condition in ChunksToZarr when template is not supplied explicitly as an xarray.Dataset

shoyer opened this issue · 1 comments

shoyer commented

Due to zarr-developers/zarr-python#1435, ChunkToZarr can result in invalid Zarr files if the template is written simultaneously from different workers.

shoyer commented

#112 partially resolves this issue, by deprecating using ChunksToZarr without a template.