Write a migration script
Closed this issue · 1 comments
abompard commented
A migration script must be written.
Acceptance criteria:
- import the existing data in the old database format to the new timescaledb-based database.
- should accept a start date, to make it possible to import data in multiple passes.
- should skip messages that are already in the database (using the msgid as an identifier)
- the two databases (the old and the new) can be on two different postgresql servers
- a custom JSON serializer was used in fedmsg, which means that the json strings currently in the database may need processing before being imported into the new database. Expect surprises there.
- the import progress should be reported in some way. If cancelled, the import process should print out the timestamp of the latest import, to simplify resuming from that point.
References: