- pyenv for python version control
- pipenv for python package control
- R and R studio
- install pyenv from following link https://github.com/pyenv/pyenv
- install pipenv from following link https://github.com/pypa/pipenv
- Install R from https://linuxize.com/post/how-to-install-r-on-ubuntu-20-04/
- install Rstudio https://www.rstudio.com/products/rstudio/download/
- Install IRkernel to run R script in Jupyter notebook/lab
- elyra will raise error when python version is 3.9.x with pipenv
- tested with v3.7.12 with poetry [successful]
- please use 3.7.12 [i.e align with Kaggle notebook]
- add in the requirements.txt
- or pipenv automatically install the required packages
- clone the repo and run pipenv install
- If dependencies error will occure, please install pre
- this method will be easy for Unix family
- Jupyter lab need to rebuild some packages such as elyra
- Notebook for prototyping and check data information
- Notebook may be either R or Python
- Install R kernel with requried packages
- Note visulization is not for DASH or streamlit [we will use viola or bokeh]
- data will be written as batch mode to save in DB
- data dashboard will be apache supreset