shabados/database

Build database with streams

Opened this issue · 0 comments

The current method of transform in memory is not the most efficient, and can take a lot of time. Better to build a pipeline of transform streams for building the SQLite (and maybe even the build-json, but i don't think that's as possible?)