dinhln03/dotdotdot

Temporary rec

About The Project

(back to top)

Getting Started

General Setup

1. Clone the repository:

git clone https://github.com/dinhln03/HM-ScalableRecs.git

2. Change directory to the project root and export the project root path:

cd HM-ScalableRecs
export ROOT_DIR=$(pwd)

3. Install Poetry to manage dependencies

4. Install miniconda to manage Python environments

5. Create a new conda environment with Python 3.11.9:

conda create --prefix ./.venv python=3.11.9

6. Make the Poetry use the new Python 3.11.9 conda environment:

poetry env use ./.venv/bin/python

7. Install the project dependencies:

poetry install

8. Create .env file based on the .env.example file.

I. Data Preparation

1. Build up Data Hub, a framework of unified discovery, observability, and governance for data:

   make datahub-up

   Expected output:

   

2. Build up OLTP and Data Warehouse (both are Postgre) to store the data:

   make oltp-dwh-up

   Expected output: