/haiku-dpo

Using open source LLMs to build synthetic datasets for direct preference optimization

Primary LanguageJupyter Notebook

Issues