/FineTuningLlama2

This is a repository where I have fine-tuned an Llama2 on an open source dataset from Kaggle.

Primary LanguageJupyter Notebook

FineTuningLlama2

This is a repository where I have fine-tuned an Llama2 on an open source dataset from Kaggle.

Objective

The objective of this project is when you input an product name it will give you the department.

Dataset

Product and description from Instacart Market Basket Analysis (https://www.kaggle.com/competitions/instacart-market-basket-analysis/data?select=products.csv.zip)

image

Mechanism Details

  • Model used: 'TinyPixel/Llama-2-7B-bf16-sharded'

Result Plots

image

System Properties

image

RAM and GPU Usage from Google Colab

image