The official implementation of Self-Play Preference Optimization (SPPO)
Primary LanguagePythonApache License 2.0Apache-2.0
No issues in this repository yet.