This code reads data from heavy CSV files, reading in chunks for the best approach of inserting data into an SQLServer.
The code contains the requirements.txt, create a virtual env using this file before attempting to execute it. Once cloned, cd over the new directory.
$ git clone ~/DataEngineering-FileToSQLServerChuncks.git
$ conda create -n FileToSQLServerChuncks python=3.7
$ conda activate FileToSQLServerChuncks
$ pip install requirements.txt
- Enrique Plata - 2019-10-05