DARSHANH-analytics/DVC_DL_Tensorflow_demo

DVC - DL - TF - AIOPS demo

download data --> source

commands -

create a new env

conda create --prefix ./env python=3.7 -y

activate new env

source activate ./env

init DVC

git init
dvc init

create empty files -

mkdir -p src/utils config
touch src/__init__.py src/utils/__init__.py param.yaml dvc.yaml config/config.yaml src/stage_01_load_save.py src/utils/all_utils.py setup.py .gitignore

install src

pip install -e .

outside data folder is created inside data folder but this data will be received from outside say aws buckets ...etc.

stage_01_load_save has code to copy outside data to project data folder even though outside data is inside data folder, in ideal case outside data folder will not be there so code added considering data will be received from outside