/fine-llama

The finetunning of the LlaMa model.

Primary LanguageJupyter NotebookApache License 2.0Apache-2.0

Finetuning the LlaMa model on a custom dataset.

Main component: Dataset formating

Here we'll put the steps on creating the finetunning dataset.

file format: .csv

MUST HAVE = column named text

Training Script

We use the Hugging face autotrain library