Dataset analyzer should not run on locked files
Closed this issue · 0 comments
anjakefala commented
23 18:01:21 marimba dias[15059]: [2020-11-24 02:01:21,917] dias[dataset]: Task failed: Unable to open file (truncated file: eof = 195166208, sblock->base_addr = 0, stored_eoa = 9026011548)
Nov 23 18:01:22 marimba dias[15059]: [2020-11-24 02:01:22,862] dias[dataset]: Traceback (most recent call last):
Nov 23 18:01:22 marimba dias[15059]: File "/usr/local/lib/python3.7/dist-packages/dias/task.py", line 231, in runner
Nov 23 18:01:23 marimba dias[15059]: result = self.analyzer.run()
Nov 23 18:01:23 marimba dias[15059]: File "/usr/local/lib/python3.7/dist-packages/dias/analyzers/dataset_analyzer.py", line 136, in run
Nov 23 18:01:23 marimba dias[15059]: "chime_flaginput", tstart, tend, only_unprocessed=False
Nov 23 18:01:23 marimba dias[15059]: File "/usr/local/lib/python3.7/dist-packages/dias/analyzer.py", line 283, in new_files
Nov 23 18:01:23 marimba dias[15059]: self.name, filetypes, start, end, only_unprocessed
Nov 23 18:01:23 marimba dias[15059]: File "/usr/local/lib/python3.7/dist-packages/dias/utils/tracker.py", line 374, in new_files
Nov 23 18:01:23 marimba dias[15059]: self.update_file_table()
Nov 23 18:01:23 marimba dias[15059]: File "/usr/local/lib/python3.7/dist-packages/dias/utils/tracker.py", line 339, in update_file_table
Nov 23 18:01:23 marimba dias[15059]: self.insert_files([f for f in files_on_disk if f not in files_in_db])
Nov 23 18:01:23 marimba dias[15059]: File "/usr/local/lib/python3.7/dist-packages/dias/utils/tracker.py", line 273, in insert_files
Nov 23 18:01:23 marimba dias[15059]: with h5py.File(f, "r") as source:
Nov 23 18:01:23 marimba dias[15059]: File "/usr/local/lib/python3.7/dist-packages/h5py/_hl/files.py", line 427, in __init__
Nov 23 18:01:23 marimba dias[15059]: swmr=swmr)
Nov 23 18:01:23 marimba dias[15059]: File "/usr/local/lib/python3.7/dist-packages/h5py/_hl/files.py", line 190, in make_fid
Nov 23 18:01:23 marimba dias[15059]: fid = h5f.open(name, flags, fapl=fapl)
Nov 23 18:01:23 marimba dias[15059]: File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
Nov 23 18:01:23 marimba dias[15059]: File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
Nov 23 18:01:23 marimba dias[15059]: File "h5py/h5f.pyx", line 96, in h5py.h5f.open