openai/evals

Evals broken with latest openai package v1.1.1

ojaffe opened this issue · 2 comments

ojaffe commented

Describe the bug

openai package v1.1.1 has changed their error handling. Now openai.error raises an AttributeError. These lines will raise an AttributeError when running any eval, as this is part of the backoff logic which is used for both base and chat completion functions.

To Reproduce

  1. Clone repo
  2. Install dependencies
  3. Run oaieval gpt-4 2d_movement

Code snippets

No response

OS

macOS

Python version

Python v3.9

Library version

openai-evals v0.1.1

onjas-buidl commented

encounter the same issue here

  • 👍1
isaduan commented

encountered the same issue here. getting "module 'openai' has no attribute 'error' when trying to run the "make me pay" eval

  • 👍1