Update neo4J regularly

Question

wzkariampuzha opened this issue 2 years ago · 7 comments

query PubMed regularly and update neo4J db

Answer 1 · 2022-06-07T14:49:03.000Z

We also need to query OMIM API regularly and check any newly added references

Answer 2 · 2022-06-08T14:27:09.000Z

Devon is working on PubMed and Richard is working on OMIM

Answer 3 · 2022-06-08T14:32:34.000Z

We should add all references from OMIM, including PubMed indexed ones and non-PubMed indexed ones

Answer 4 · 2022-06-13T17:11:23.000Z

Also remove publications older than 50 years. and update weekly @qianzhu2018 Do you want to do a sliding date window

Answer 5 · 2022-06-13T17:29:53.000Z

Edit the initial_loading python script to support full database creation and reoccurring updates

Check txt or json file to see if a "database_exists" variable is set to True
- if "database_exists" == False, set minimum date to lowest date needed for full creation
- if "database_exists" == True, access the txt or json file for the last time the script was ran and set the minimum retrieval date to that date

Answer 6 · 2022-06-14T21:21:42.000Z

@devonleadman Fixed the update function here: #9

Answer 7 · 2022-06-15T15:08:10.000Z

Needs to have a cron script or something natively on linux machine that automatically calls the update-neo4j.py script