olufemiolajide/simple-dvc-demo4

create env

conda create -n wineq python=3.7 -y

activate env

conda activate wineq

created a req file

install the req

pip install -r requirements.txt

download the data from: https://drive.google.com/drive/folders/18zqQiCJVgF7uzXgfbIJ-04zgz1ItNfF5?usp=sharing

• Develop README.md
• Develop template.py script
• move (manually) dataset into data_given folder

git init

dvc init 

dvc add data_given/winequality.csv

git add .

git commit -m "first commit"

oneliner updates for README.md

git add . && git commit -m "update Readme.md"

Open your GITHUB account

Create a new repo named "simple-dvc-demo4"

click on "create repository"

git remote add origin https://github.com/olufemiolajide/simple-dvc-demo4.git
git branch -M main
git push origin main

Develop params.yaml file

git add . && git commit -m "params added"
git push origin main

Develop get_data.py

• Install some dependencies

pip install pandas
pip install PyYAML

Test get_data.py

python src\get_data.py
git add . && git commit -m "add get_data.py"
git push origin main

Develop load_data.py

python src\get_data.py
git add . && git commit -m "add get_data.py"
git push origin main

Develop params.yaml

dvc repro
git add . && git commit -m "add params.yaml"
git push origin main

Add train_and_evalaute.py

Add Report Folders - params.json and scores.json - if you havent added them before

dvc repro
dvc params diff
dvc metrics show
dvc metrics diff
git add . && git commit -m "tracker added"
git push origin main

complete tox.ini

tox command -

tox

for rebuilding -

tox -r 

pytest command

pytest -v

Develop setup.py file

setup commands -

pip install -e . 

pip freeze  #to see what packages are installed in th elibrary

build your own package commands-

python setup.py sdist bdist_wheel

you can delete the dist folder created because it is not required

tox

Push to repo

git add . && git commit -m "pytest and setup done" git push origin main

import pytest

class NotInRange(Exception):
    def __init__(self, message="value not in range"):
        self.message = message
        super().__init__(self.message)


def test_generic():
    a = 5
    with pytest.raises(NotInRange):
     if a not in range(10, 20):
        raise NotInRange

git add . && git commit -m "pytest example" && git push origin main Develop "webapp/static/css/main.css", "webapp/templates/404.html", "webapp/templates/base.html", and "webapp/templates/index.html" git add . && git commit -m "web structure added" && git push origin main

copy (manually) the file "saved_models/model.joblib" to the folder "prediction_service/model"

complete prediction_service/schema_in.json

complete "prediction_service/prediction.py"

git add . && git commit -m "app created and tested" && git push origin main

CI-CD using Github Actions

complete ".github/workflows/ci-cd.yaml" git add . && git commit -m "github action workflow added" && git push origin main

Heroku Deployment

Watch Day 3 - 2hrs 12mins complete "Procfile" git add . && git commit -m "Heroku workflow updated" && git push origin main