USEPA/Stormwater-Management-Model

Optional output and model state persistence using HDF5

Opened this issue · 2 comments

HDF5 provides an open-source self-describing, transparent, efficient, and portable way for storing heterogenous data. It is fast becoming the de facto standard for storing and organizing large scientific datasets. This effort will involve implementing a way to optionally write swmm output and model state in the HDF5 format. This will greatly facilitate several applications and options users have long asked for including more detailed summary of diagnostic information (e.g. #32 ), saving optional periods (#156 ), prescribing model state externally for digital twin development applications, etc.

@cbuahin, love this idea. I’ve been wrong more times than I can count but would this support the ability to read data from the output while the simulation is iterating? I think we talked about this before … but I can’t remember

Definitely did. I forgot to add the one benefit you have correctly highlighted. The ability to read the output and track the simulation while it is running will be a huge benefit.