/scale

Let's work on large scale!

Primary LanguageJavaScript

Large file to DB

Problem statement

Given a large JSON file, fetch records and save in DB

Tech Stack
  • Node
  • MongoDB
  • Express
  • Mongoose
How to USE
  • Run node createLargeFile.js to create a JSON file of 190 MB containing 1 million records
  • Run mongod to start MongoDB Server
  • Run node scriot.js to start import from file to DB

Note:

Currently the BATCH_INSERT_VALUE in config.json is set to 1000 (Best value for batch insert according to completion time of script.js)