Time stored in track output file
Closed this issue · 3 comments
I think I'm running into an issue where only the year of the decade and first year of the decade are reported in the output track file for each consecutive decade tracked.
For example,. say I'm tracking 1950-1960, the year listed in the track output file will only show 1950 or 1951 and then jump to 1960 to 1961. It does this consistently for all decades.
This is my input file for example for two decades. Any idea why that may happen? If it was only one decade I would suspect maybe something was off with the GCM, but this appears systematic.
Upon looking deeper, it's only tracking the first file in the list above (1950-1952) and discarding the rest. Not sure why it'd do that though?
Each line represents a "chunk" of data. I believe the first file on each line builds the "time array" and then each subsequent file (separated by ;) has its time coordinate matched to that master array (or if singleton, expanded). In your case, the first line begins with 1950-1951 and the next line begins with 1960-1961. The other zg files come after in that line -- none of their times match during a lookup, so their data is not used in that line.
so you want each of those zg files to start a new line. Here's an example with HighResMIP data...
/storage/home/cmz5202/scratch/HRMIP_CNRM2//zg_6hrPlevPt_CNRM-CM6-1-HR_highresSST-present_r1i1p1f2_gr_195001010600-195007010000.nc;/storage/home/cmz5202/scratch/HRMIP_CNRM2//vas_6hrPlevPt_CNRM-CM6-1-HR_highresSST-present_r1i1p1f2_gr_195001010600-195201010000.nc;/storage/home/cmz5202/scratch/HRMIP_CNRM2//uas_6hrPlevPt_CNRM-CM6-1-HR_highresSST-present_r1i1p1f2_gr_195001010600-195201010000.nc;/storage/home/cmz5202/scratch/HRMIP_CNRM2//psl_6hrPlevPt_CNRM-CM6-1-HR_highresSST-present_r1i1p1f2_gr_195001010600-195201010000.nc;/storage/home/cmz5202/work/sw/cmip-etcs/CNRM-CM6-1-HR.topo.nc
/storage/home/cmz5202/scratch/HRMIP_CNRM2//zg_6hrPlevPt_CNRM-CM6-1-HR_highresSST-present_r1i1p1f2_gr_195007010600-195101010000.nc;/storage/home/cmz5202/scratch/HRMIP_CNRM2//vas_6hrPlevPt_CNRM-CM6-1-HR_highresSST-present_r1i1p1f2_gr_195001010600-195201010000.nc;/storage/home/cmz5202/scratch/HRMIP_CNRM2//uas_6hrPlevPt_CNRM-CM6-1-HR_highresSST-present_r1i1p1f2_gr_195001010600-195201010000.nc;/storage/home/cmz5202/scratch/HRMIP_CNRM2//psl_6hrPlevPt_CNRM-CM6-1-HR_highresSST-present_r1i1p1f2_gr_195001010600-195201010000.nc;/storage/home/cmz5202/work/sw/cmip-etcs/CNRM-CM6-1-HR.topo.nc
/storage/home/cmz5202/scratch/HRMIP_CNRM2//zg_6hrPlevPt_CNRM-CM6-1-HR_highresSST-present_r1i1p1f2_gr_195101010600-195107010000.nc;/storage/home/cmz5202/scratch/HRMIP_CNRM2//vas_6hrPlevPt_CNRM-CM6-1-HR_highresSST-present_r1i1p1f2_gr_195001010600-195201010000.nc;/storage/home/cmz5202/scratch/HRMIP_CNRM2//uas_6hrPlevPt_CNRM-CM6-1-HR_highresSST-present_r1i1p1f2_gr_195001010600-195201010000.nc;/storage/home/cmz5202/scratch/HRMIP_CNRM2//psl_6hrPlevPt_CNRM-CM6-1-HR_highresSST-present_r1i1p1f2_gr_195001010600-195201010000.nc;/storage/home/cmz5202/work/sw/cmip-etcs/CNRM-CM6-1-HR.topo.nc
/storage/home/cmz5202/scratch/HRMIP_CNRM2//zg_6hrPlevPt_CNRM-CM6-1-HR_highresSST-present_r1i1p1f2_gr_195107010600-195201010000.nc;/storage/home/cmz5202/scratch/HRMIP_CNRM2//vas_6hrPlevPt_CNRM-CM6-1-HR_highresSST-present_r1i1p1f2_gr_195001010600-195201010000.nc;/storage/home/cmz5202/scratch/HRMIP_CNRM2//uas_6hrPlevPt_CNRM-CM6-1-HR_highresSST-present_r1i1p1f2_gr_195001010600-195201010000.nc;/storage/home/cmz5202/scratch/HRMIP_CNRM2//psl_6hrPlevPt_CNRM-CM6-1-HR_highresSST-present_r1i1p1f2_gr_195001010600-195201010000.nc;/storage/home/cmz5202/work/sw/cmip-etcs/CNRM-CM6-1-HR.topo.nc
/storage/home/cmz5202/scratch/HRMIP_CNRM2//zg_6hrPlevPt_CNRM-CM6-1-HR_highresSST-present_r1i1p1f2_gr_195201010600-195207010000.nc;/storage/home/cmz5202/scratch/HRMIP_CNRM2//vas_6hrPlevPt_CNRM-CM6-1-HR_highresSST-present_r1i1p1f2_gr_195201010600-195401010000.nc;/storage/home/cmz5202/scratch/HRMIP_CNRM2//uas_6hrPlevPt_CNRM-CM6-1-HR_highresSST-present_r1i1p1f2_gr_195201010600-195401010000.nc;/storage/home/cmz5202/scratch/HRMIP_CNRM2//psl_6hrPlevPt_CNRM-CM6-1-HR_highresSST-present_r1i1p1f2_gr_195201010600-195401010000.nc;/storage/home/cmz5202/work/sw/cmip-etcs/CNRM-CM6-1-HR.topo.nc
Note how zg files contained the smallest duration of data, therefore I use them as the lead file and the "longer" psl, uas, etc. files come later in the line.
@zarzycki thank you!
yep I reached the same conclusion after looking more closely.