/parse_cmep

Parse a delimited CMEP file to a single value row CSV

Primary LanguagePython

parse_cmep.py

Parse a delimited CMEP (California Metering Exchange Protocol) file to a single value row CSV

Usage			: python3 parse_cmep.py -f CMEP_Format_sample.txt -d '\t' -r 14 --header

Outputted rows		: [Meter ID], [Timestamp], [Constant Calculation], [Quality Code], [Value]
Outputted filename	: parsed_cmep_[commodity id]_[unit of measurement]_[process id].csv

Author 			: Mike Czabator

mike@lenovo ~/mike/tools/cmep_file_parser
$ python3 parse_cmep.py --delimiter '\t' --file CMEP_Format_sample.txt --header

***************
Input file           : CMEP_Format_sample.txt
input CMEP file lines: 10000
output CSV lines     : 96755
time                 : 2.2290380001068115 seconds / 0 minutes
***************

mike@lenovo ~/mike/tools/cmep_file_parser
$ head parsed_cmep_E_KWH.27772.csv
123456,201811020700,KWH,1,,1.23
123456,201811020800,KWH,1,,1.173
123456,201811020900,KWH,1,,1.173
123456,201811021000,KWH,1,,1.173
123456,201811021100,KWH,1,,1.173
123456,201811021200,KWH,1,,1.23
123456,201811021300,KWH,1,,1.23
123456,201811021400,KWH,1,,1.288
123456,201811021500,KWH,1,,1.23
123456,201811021600,KWH,1,,1.23
...