ecraft/couchdb_to_sql

Perform SQL insertions in bulk

Opened this issue · 0 comments

At the moment, SQL inserts are being performed one row at a time. This has significant performance impacts. We should look into changing this to use Sequel's great multi_insert support to speed it up.

One of the challenges here is that we receive the data from CouchDB in very small chunks (6 rows per chunk). I wonder if that could be tweaked somehow...