NVIDIA/earth2mip

๐Ÿš€[FEA]: Add better IO support

dallasfoster opened this issue ยท 1 comments

Is this a new feature, an improvement, or a change to existing functionality?

New Feature

How would you describe the priority of this feature request

Critical (currently preventing usage)

Please provide a clear description of problem you would like to solve.

We should update IO support to be easier to use, not just in pipelines.

  • We should support a variety of backends, mainly through xarray.
  • We should use the notion that data carries around with it metadata (and the metadata should be sufficient to instantiate an xarray dataset/dataArray.
  • We should limit how many variables can be added to a dataset.
  • Users should be able to add their own backends without adding PR's to the repo.

Describe any alternatives you have considered

No response

Closing based on internal discussions