/gemma-red-russian

Gemma Fine-Tuning with LoRA [HuggingFace]

Primary LanguageJupyter Notebook

🛠️ Red Russian Gemma (WIP)

Kaggle

Red Russian Gemma

Overview

This project fine-tunes a Gemma language model using PEFT and LoRA on this dataset.

This is a dataset of texts by communist authors of the Soviet era. Everything is in Russian language.

The goal is to generate text that reflects general communistic patterns (and writing styles of any of these author) in writing speech.

To Do

  • Upload .ckpt model
  • Upload python files
  • Add markdown comments to notebook