File locking for molecule cache to prevent corruption
Opened this issue · 1 comments
rosemary-mantell-cresset commented
At the moment, SmallMoleculeTemplateGenerator does not implement any file locking for the small molecule cache database. This means that the cache file can become corrupted if several processes try to access it at once. It would be good if this could be fixed in a way that also works with NFS. We have had some success in fixing the issue in our own copy of the code with the NFS-safe file locking library flufl.lock (https://pypi.org/project/flufl.lock/).
ijpulidos commented
Thanks for this report. This does seem important. I think we would benefit from seeing how you implemented this and try to fit the same fix in our code base. Is this publicly available somewhere we can check?