aguinane/nem-reader

Handle missing 100 record

dwjp opened this issue · 5 comments

dwjp commented

Despite being mandatory, I often see NEM12 files where the 100 header record is skipped (particularly for interval data from Powercor/Citipower portals).

Looking through nem_reader.py it appears parsing will raise an exception if this is the case?

Would be useful to have an option to ignore this, or catch and decide whether to continue on case-by-case basis.

Should be easy enough to add an option to generate a warning instead of an error with a flag and then assume that it's NEM12 and not NEM13 and continue. Will add it when I get time otherwise feel free to submit a PR.

dwjp commented

Thanks, will submit a PR when I get a free moment. I have some other weird out-of-spec NEM12 files to work through so suspect it'll raise some other issues to work through.

Should there be documentation about ignore_missing_header=True?

Yeah should probably be added to documentation, and probably default to True when using the CLI maybe?

Making some changes for another issue and changed this to a strict option that is False by default.