/UltraFeedback

A large-scale, fine-grained, diverse preference dataset (and models).

Primary LanguagePythonMIT LicenseMIT

Stargazers