/Enlighten-Instruct

Fine-tune Mistral-7b on the Enlighten codebase

Primary LanguageJupyter NotebookMIT LicenseMIT

Enlighten-Instruct

Fine-tune Mistral-7b on the Enlighten codebase

Dataset is already available in the dataset folder but you can create your version with DataGenerator.ipynb
Run FineTune.ipynb on Google Colab
Run MergeAdapterWithBase.ipynb and quantize-gguf.ipynb on Kaggle

Adapter - merged model - Quantized model