pangeo-forge/pangeo-forge-recipes

Issues

• Provide examples for provenance metadata (including more complex nested examples)

  #782 opened 2 months ago by jbusecke
  0

• Stage to check if URLS are alive?

  #719 opened 4 months ago by jbusecke
  2

• ValueError: Region (...) does not align with Zarr chunks ().

  #644 opened a year ago by ghislainp
  9

• Could/Should our caching step support scp?

  #753 opened 7 months ago by jbusecke
  4

• Options for the fsspec sync hanging bug

  #754 opened 6 months ago by norlandrhagen
  1

• Revert changes made in #657

  #720 opened 6 months ago by jbusecke
  0

• High level problem case: Files with A LOT OF VARIABLES

  #736 opened 8 months ago by jbusecke
  1

• fsspec_target.from_url losing protocol

  #752 opened 7 months ago by moradology
  0

• Support for THREDDS links

  #724 opened 7 months ago by jbusecke
  1

• Alternative to dropping attributes that vary between datasets

  #743 opened 8 months ago by jbusecke
  2

• Strange Interactions with Transposition and StoreToZarr

  #710 opened 9 months ago by ranchodeluxe
  5

• Write Docs about the structure of a 'Community Bakery'

  #735 opened 8 months ago by jbusecke
  0

• Optimize Data Reuse in StoreToZarr and Similar Processes

  #730 opened 9 months ago by moradology
  1

• Potentially (M)RE for 'hanging' during rechunk based on CMIP6 recipes.

  #715 opened 9 months ago by jbusecke
  45

• copy_to_local in OpenWithXarray not working on Dataflow

  #722 opened 9 months ago by jbusecke
  7

• Discussion: Composition without Memory Bloat

  #709 opened 9 months ago by ranchodeluxe
  0

• Document rechunking logic and clarify terminology

  #716 opened 9 months ago by jbusecke
  0

• Improve resource utilization/efficiency of file caching

  #713 opened 9 months ago by jbusecke
  1

• LocalDirectRunner for kerchunk recipe returns missing chunks

  #686 opened 9 months ago by abarciauskas-bgse
  3

• Consolidating release notes

  #705 opened 10 months ago by abarciauskas-bgse
  3

• How to use multiprocessing / multithreading with direct runner

  #618 opened a year ago by rabernat
  15

• Error opening zipped tiff collection via OpenURLWithFSSpec recipe

  #659 opened a year ago by thodson-usgs
  2

• `write_combined_reference` on `main` doesn't reuse dep injected `FSSpecTarget` credentials

  #666 opened a year ago by ranchodeluxe
  4

• Xarray Cannot Read `ConsolidateMetadata` Reference Output

  #675 opened a year ago by ranchodeluxe
  7

• Unzipping and filtering OpenURLWithFSSpec ouput before OpenWithXarray

  #672 opened a year ago by Riccardo7-DS
  2

• MUR SST Kerchunk recipe

  #647 opened a year ago by abarciauskas-bgse
  5

• Support skipping + retry recipes for failure recovery (aka "skipsies")

  #670 opened a year ago by abarciauskas-bgse
  2

• Graceful Openers for Connection Timeouts?

  #667 opened a year ago by ranchodeluxe
  1

• How to deal with 'side input' recipe - Example static ocean grid

  #663 opened a year ago by jbusecke
  3

• Output target chunks to logs?

  #656 opened a year ago by jbusecke
  1

• Add "Advanced Recipe Developers Gotchas/FAQs/Tips/Tricks"

  #653 opened a year ago by jbusecke
  0

• Minio tests failing

  #645 opened a year ago by cisaacstern
  1

• How reusable are our sequential functions (e.g., in Flyte, Bytewax, etc.)?

  #621 opened a year ago by cisaacstern
  1

• [DOC] Warn about difficulty of pulling data from HPC

  #639 opened a year ago by TomNicholas
  15

• `WriteCombinedReference` should emit a `zarr.storage.FSStore` (like `StoreToZarr`)

  #608 opened a year ago by cisaacstern
  4

• Nest `CombineReferences` inside `WriteCombinedReferences`

  #634 opened a year ago by cisaacstern
  2

• `full_target.fs.protocol` returns multiple protocols

  #629 opened a year ago by norlandrhagen
  6

• Maybe deprecate `ConcatDim.nitems_per_file`

  #633 opened a year ago by cisaacstern
  0

• Passing preprocessor to MultiZarrToZarr raises PicklingError

  #616 opened a year ago by chuckwondo
  11

• Release fails without setup.py

  #626 opened a year ago by cisaacstern
  0

• Test multiple merge dims

  #624 opened a year ago by cisaacstern
  0

• Test against `minio` target storage

  #623 opened a year ago by cisaacstern
  0

• Xarray-to-Zarr recipe runs out of memory

  #614 opened a year ago by chuckwondo
  15

• Missing py.typed marker

  #612 opened a year ago by chuckwondo
  2

• Pip for ci (PR 605) follow-on work

  #606 opened a year ago by cisaacstern
  1

• Follow-on work to PR 590 (integration testing)

  #609 opened a year ago by cisaacstern
  0

• Speed up unit test runs

  #604 opened a year ago by cisaacstern
  1

• Is there a `mypy` extension for beam that understands `.expand`?

  #600 opened a year ago by cisaacstern
  2

• Streaming pipelines subscribed to source data arriving in a cache bucket

  #598 opened a year ago by cisaacstern
  2

• Deprecate python 3.9 support

  #589 opened a year ago by cisaacstern
  1