aodn/python-aodncore

pipeline failure -> files pushed to $ERROR_DIR with limited permissions

Closed this issue · 1 comments

The following file 20180930173744-ABOM-L3U_GHRSST-SSTskin-AVHRR19_D-Des_Southern.nc was triggered by the pipeline and led to a bug (now fixed):

  File "/mnt/ebs/aodn-pipeline/local/lib/python2.7/site-packages/aodncore/pipeline/files.py", line 780, in set_dest_paths
    candidate_path = dest_path_function(f.src_path)
  File "/mnt/ebs/aodn-pipeline/local/lib/python2.7/site-packages/aodndata/srs/srs_ghrsst.py", line 112, in dest_path
    file_info = get_info_nc(filepath)
  File "/mnt/ebs/aodn-pipeline/local/lib/python2.7/site-packages/aodndata/srs/srs_ghrsst.py", line 49, in get_info_nc
    fields = get_pattern_subgroups_from_string(file_basename, pattern=L3U_FILE_PATTERN)
TypeError: get_regex_subgroups_from_string() got an unexpected keyword argument 'pattern'
2018-10-01 12:58:29,505 SYSINFO tasks.SRS_GHRSST[3e8ffacf-5c7a-443b-9c0b-050dc398aef1] get_notify_runner -> 'NotifyRunnerAdapter'
2018-10-01 12:58:29,505 SYSINFO tasks.SRS_GHRSST[3e8ffacf-5c7a-443b-9c0b-050dc398aef1] get_child_notify_runner -> 'EmailNotifyRunner'

The file was pushed as

-rw------- 1 pipeline_worker projectofficer   5257684 Oct  1 13:57 20180930173744-ABOM-L3U_GHRSST-SSTskin-AVHRR19_D-Des_Southern.nc

to the $ERROR_DIR, meaning PO's can't do much with this limiting permission

See linked PR for fix.