[QST]
jedwards4b opened this issue · 6 comments
What is your question?
Has anyone created an hdf5 filter using nvCOMP?
@jedwards4b The only ones we are aware of is the ParallelIO team that you probably are very familiar with already.
Could you describe your use case a bit more? If it is read heavy, there is another potential path. We are looking at the zarr format and you can actually make HDF5 datasets look like zarr using a tool called kerchunk without actually transcoding the dataset. Would this be something you are interested in?
We did this for an Nvidia hackathon last week at ncar. Our application is write not read heavy. Our primary issue now is that our datasets need to be portable and so we would like,for example, a file zstandard compressed using nvcomp to be able to be decompressed by the default zstandard library. Not quite sure how to manage that yet.
Discussion moved to #80
This issue has been labeled inactive-30d due to no recent activity in the past 30 days. Please close this issue if no further response or action is needed. Otherwise, please respond with a comment indicating any updates or changes to the original issue and/or confirm this issue still needs to be addressed. This issue will be labeled inactive-90d if there is no activity in the next 60 days.
This issue has been labeled inactive-90d due to no recent activity in the past 90 days. Please close this issue if no further response or action is needed. Otherwise, please respond with a comment indicating any updates or changes to the original issue and/or confirm this issue still needs to be addressed.
Issue #80 seems to subsume this one, so I'm closing this one.