This repo contains my own exploration of the LLM world right now. I am interested mostly in fine-tuning LMs for text generation tasks. This implies:
- Dataset preparation and preprocessing
- Model fine-tuning with libraries like Axolotl, HuggingFace, etc.
- Model evaluation