/ailex

Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first approach

Primary LanguagePythonMIT LicenseMIT

No issues in this repository yet.