Create new directory for post processing data
uniomni opened this issue · 6 comments
uniomni commented
Currently post processing data is stored with the raw input data making it difficult to clean out and rerun.
Suggest making a new director for post processing data which can easily be deleted without affecting the raw input data.
PetarMilevski commented
did git pull
i get this error
('data_directory', '/home/petar/media/petar/TOSHIBA EXT/PyARR-data/1%AEP/')
('proc_directory', '/home/petar/media/petar/TOSHIBA
EXT/PyARR-postprocessed-data/1%AEP/')
Postprocessing storm 1 for quantity WL at all specified locations
Traceback (most recent call last):
File "2_critical_duration_patterns.py", line 17, in <module>
points_dict = post_process(durations=durations, locations=locations,
storm=storm, quantity=quantity, proc_directory=proc_directory,
blockage=blockage)
File "/home/petar/PyARR/ARR2019_post_processing.py", line 198, in
post_process
points_dict = critical_duration_pattern(fromdir, locations)
File "/home/petar/PyARR/ARR2019_post_processing.py", line 142, in
critical_duration_pattern
mean, (one_up_filename, value) = find_average_element(filename_list)
File "/home/petar/PyARR/ARR2019_post_processing.py", line 68, in
find_average_element
raise BaseException('Got an empty list: %s' % filename_list)
BaseException: Got an empty list: []
…------------------
(program exited with code: 1)
Press return to continue
On Fri, May 21, 2021 at 3:50 PM Ole Nielsen ***@***.***> wrote:
Closed #2 <#2>.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
<#2 (comment)>, or
unsubscribe
<https://github.com/notifications/unsubscribe-auth/AETRNNSUKJYGJQHYAFKYYLLTOXYATANCNFSM45IFY5SA>
.
uniomni commented
Looks like your proc directory directory has a newline in it?
uniomni commented
I think this means the data hasn't been processed for that duration. It fails for me as well if I go past the processed data.
uniomni commented
Just added some diagnostics. We also need a better error message for this situation.
PetarMilevski commented
still cant get it. my data is all processed from 10 min to 2160min. really
weird.
Im getting tired, will leave it till tomorrow.
…On Fri, May 21, 2021 at 4:46 PM Ole Nielsen ***@***.***> wrote:
Just added some diagnostics. We also need a better error message for this
situation.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
<#2 (comment)>, or
unsubscribe
<https://github.com/notifications/unsubscribe-auth/AETRNNWBH7LJS7OAHAYGJCDTOX6VZANCNFSM45IFY5SA>
.