mozilla/ssh_scan_api

Attempt a dry run of a production data from mongodb to a local postgres DB

Closed this issue · 2 comments

This is a task to connect to the existing production db, which is mongo, and run a migration using mongo2postgres.rb. If there are any bugs fix them, do some manual verification's to make sure everything still works as expected.

Dry run was attempted today and although there was a small percentage that didn't migrate in my test due to unicode being present in the target field, I think the results are reasonably promising to proceed with the migration using the script with some minor updates, which I'll push shortly.

Also, to give an expectation for how long the migration will take, we're in the magnitude of < 1min (when performed via SSH tunnel), we'll be doing the actual migration locally, so it will likely be faster than that.