xarray-contrib/xbatcher

Issues

• Blog post announcement: cloud native data loaders for machine learning using zarr and xarray

  #214 opened 4 months ago by jhamman
  0

• Slicing multiple data layers or band channels with different spatial resolutions

  #93 opened 2 years ago by weiji14
  7

• Performance benchmarks

  #42 opened 3 years ago by jhamman
  6

• Additional examples with variable numbers of input/output dimensions

  #157 opened a year ago by maxrjones
  8

• Accessing some batches raises an error

  #184 opened a year ago by agirnow
  1

• [use case demonstration] Kvikio Direct-to-gpu -> xarray -> xbatcher -> ml model

  #87 opened 2 years ago by jhamman
  19

• readthedocs page won't load, hangs when other websites load

  #192 opened a year ago by rbavery
  1

• Add more graphics to the docs

  #169 opened a year ago by maxrjones
  2

• Provide tools to shard batches across different workers in Pytorch `DataLoader`

  #176 opened a year ago by arbennett
  6

• Support for valid examples

  #158 opened a year ago by ljstrnadiii
  5

• Xbatcher abstract for AMS 2023

  #91 opened a year ago by maxrjones
  6

• Separate BatchGenerator into standalone Slicer and Batcher components?

  #172 opened a year ago by weiji14
  2

• Testing improvements

  #83 opened 2 years ago by maxrjones
  0

• List examples of custom data loaders

  #49 opened 2 years ago by jhamman
  0

• Add batch_schema.to_json method

  #155 opened a year ago by maxrjones
  0

• Predicate option for BatchGenerator

  #162 opened a year ago by cmdupuis3
  3

• Slow performance using concat_input_dims=True

  #165 opened a year ago by cmdupuis3
  10

• Can't control batch size when all dims are input dims

  #163 opened a year ago by cmdupuis3
  9

• Dimension name change with `concat_input_dims` is a side effect

  #164 opened a year ago by cmdupuis3
  3

• Release v0.3.0

  #145 opened a year ago by maxrjones
  0

• Should there always be a sample dimension?

  #127 opened 2 years ago by maxrjones
  6

• Need to reduce Keras warnings

  #38 opened a year ago by cmdupuis3
  8

• Show version snapshots in xbatcher's readthedocs page

  #135 opened a year ago by weiji14
  6

• Batch generation with batch_dims in v0.2.0 is about 10-20times slower

  #121 opened 2 years ago by dhruvbalwada
  1

• `batch_dims` seems not to be respected for 0.2.0?

  #131 opened 2 years ago by arbennett
  2

• Dimension order should be set by input_dims

  #126 opened 2 years ago by maxrjones
  1

• Setup GitHub integration with Zenodo for xbatcher DOI

  #120 opened 2 years ago by maxrjones
  0

• Provide the option to return partial batches

  #123 opened 2 years ago by maxrjones
  0

• Implement __repr__ for BatchGenerator

  #129 opened 2 years ago by maxrjones
  0

• Generate batches lazily

  #111 opened 2 years ago by maxrjones
  5

• Release v0.2.0

  #104 opened 2 years ago by maxrjones
  6

• How do you put batches back together after processing

  #43 opened 3 years ago by jhamman
  4

• Add documentation/examples for new data loaders and help with use case

  #52 opened 2 years ago by djhoese
  0

• Use sphinxcontrib apidoc for autogenerated API docs

  #53 opened 2 years ago by djhoese
  2

• Cache batches

  #109 opened 2 years ago by jhamman
  2

• Clarify xbatcher license

  #99 opened 2 years ago by maxrjones
  5

• Use default configuration for code formatting with `black`

  #102 opened 2 years ago by maxrjones
  0

• Use importlib.metadata rather than pkg_resources

  #89 opened 2 years ago by maxrjones
  0

• Should we transfer this project to the xarray-contrib org?

  #86 opened 2 years ago by jhamman
  8

• Support xarray.DataArray and xarray.Dataset batches in PyTorch dataloader

  #84 opened 2 years ago by maxrjones
  2

• Input xarray.DataArray becomes xarray.Dataset

  #70 opened 2 years ago by weiji14
  0

• Add CONTRIBUTING.md

  #32 opened 2 years ago by jhamman
  0

• Add github issue/pr templates

  #44 opened 2 years ago by jhamman
  0

• Verde & Xbatcher -> Any connections / shared use?

  #76 opened 2 years ago by ThomasMGeo
  1

• Verify batch coordinates in tests

  #65 opened 2 years ago by maxrjones
  0

• Integration with Hugging Face Datasets

  #60 opened 2 years ago by rabernat
  5

• Friendlier API for multiple inputs/outputs

  #35 opened 3 years ago by cmdupuis3
  2

• Need to prepend a size 1 batch dimension to arrays returned from batch[]

  #36 opened 3 years ago by cmdupuis3
  6

• Generating the batches seems slow

  #37 opened 3 years ago by robintw
  15

• Type error in iteration routines

  #34 opened 3 years ago by cmdupuis3
  4