/data_science_toolbox

Various code to aid in data science projects for tasks involving data cleaning, ETL, EDA, NLP, viz, feature engineering, feature selection, model validation, etc.

Primary LanguagePythonMIT LicenseMIT

data_science_toolbox

Various code to aid in data science projects for tasks involving data cleaning, ETL, EDA, NLP, viz, feature engineering, feature selection, model training and validation etc.

Installation

Using pip

You can install from PyPI using the pip package manager by running

pip install data-science-toolbox

You can install the latest version by cloning this repo and installing from src

git clone https://github.com/safurrier/data_science_toolbox

cd data_science_toolbox    

pip install .    

Project Organization


├── README.md              
├── data_science_toolbox   <- Project source code
│   │
│   ├── gists              <- Code gists with commonly used code (change to root
│   │                         directory, connect to database, profile data, etc)
│   ├── data_checks        <- Code for data checks and assertions
│   ├── io                 <- Code for input/output utilities
│   ├── etl                <- For building reproducible ETL pipelines, including data
│   │                         checks and transformers
│   ├── ml                 <- Machine Learning utility code (feature engineering, etc) 
│   ├── pandas             <- Pandas related utility code
│   │   ├── analysis                  
│   │   ├── cleaning
│   │   ├── engineering
│   │   ├── text    
│   │   ├── datetime     
│   │   ├── optimization       
│   │   └── profiling   
│   ├── project_utils.py   <- For project specific utilities
│   │
│   ├── text               <- Code for dealing with text. Includes distributed loading of text corpus, 
│   │                         entity statement extraction, sentiment analysis, pii removal etc.
│   └── __init__.py        <- Makes data_science_toolbox a Python module               
├── tests                  <- Pytest unit tests 
├── dist                   <- tars and whls of version builds
├── LICENSE
├── poetry.lock
└── pyproject.toml