Daily update is very slow
xcTorres opened this issue · 3 comments
When I use --write-pgsql-change to write daily osc file into Postgres database. I found it is very slow. Only 20MB data of indonesia may take 2-3 hours, did I miss anything?
Here is the log progress when I use --write-pgsql-change. Only around 150 objects per second could be created into database.
INFO: Processing Node 8523089017 with action Create, 147.4820143884892 objects/second.
Mar 17, 2021 7:08:42 PM org.openstreetmap.osmosis.core.progress.v0_6.ChangeProgressLogger process
INFO: Processing Node 8523092219 with action Create, 148.28137490007992 objects/second.
Mar 17, 2021 7:08:47 PM org.openstreetmap.osmosis.core.progress.v0_6.ChangeProgressLogger process
INFO: Processing Node 8523096581 with action Create, 148.02237315221734 objects/second.
Mar 17, 2021 7:08:52 PM org.openstreetmap.osmosis.core.progress.v0_6.ChangeProgressLogger process
Way is much slower.
INFO: Processing Way 483372062 with action Modify, 1.8911252195056059 objects/second.
Mar 18, 2021 11:41:51 AM org.openstreetmap.osmosis.core.progress.v0_6.ChangeProgressLogger process
INFO: Processing Way 483449514 with action Modify, 0.778816199376947 objects/second.
Mar 18, 2021 11:41:57 AM org.openstreetmap.osmosis.core.progress.v0_6.ChangeProgressLogger process
INFO: Processing Way 486145715 with action Modify, 2.2756827048114436 objects/second.
Mar 18, 2021 11:42:03 AM org.openstreetmap.osmosis.core.progress.v0_6.ChangeProgressLogger process
INFO: Processing Way 486351833 with action Modify, 0.9038322487346349 objects/second.
Mar 18, 2021 11:42:08 AM org.openstreetmap.osmosis.core.progress.v0_6.ChangeProgressLogger process
INFO: Processing Way 489783151 with action Modify, 2.321981424148607 objects/second.
Mar 18, 2021 11:42:14 AM org.openstreetmap.osmosis.core.progress.v0_6.ChangeProgressLogger process
INFO: Processing Way 494364952 with action Modify, 2.146690518783542 objects/second.
Seems it is my Postgres database issue, when I set up the database on a new server it is much faster.