gitdagray/csv-to-sql-insert

Stream CSV file reading & SQL file writing

Vikram0118 opened this issue · 2 comments

Vikram0118 commented

The CSV file can get very huge. So, depending on the size of your CSV file, we might want to consider streaming the file instead of reading the entire content into memory.

gitdagray commented

This is a good idea!! 💯

Vikram0118 commented

Processing them sequentially might lead to performance bottlenecks. Parallelizing the processing of multiple rows simultaneously can significantly improve overall performance. I once came across promise.all() for a project doing parallel reading. we can add that.

  • 🎉2