/llm_recipes

A set of scripts and notebooks on LLM finetunning and dataset creation

Primary LanguageJupyter Notebook

LLM Recipes

This repo contains my own exploration of the LLM world right now. I am interested mostly in fine-tuning LMs for text generation tasks. This implies:

  • Dataset preparation and preprocessing
  • Model fine-tuning with libraries like Axolotl, HuggingFace, etc.
  • Model evaluation