/etl-using-python-pandas

ETL (Extract, Transform and Load) using python pandas module

Primary LanguagePython

ETL (Extract, Transform and Load) using Python Pandas Module

The process includes:-

Extracting the raw data from various data sources like CSV and JSON files. Transforming the extracted data into a useful format. Loading the final transformed output into a CSV file. Also logging the output to a log file.

Steps to run the script

1. python -m venv venv (Windows)
   python3 -m venv venv (Linux/MAC)

2. .\venv\Scripts\activate (Windows)
   source venv/bin/activate (Linux/MAC)

3. pip install -r requirements.txt

4. python app.py (Windows)
   python3 app.py (Linux/MAC)