openevals-testing

To get started, set your Langsmith API key and OpenAI API key in a new .env file:

LANGCHAIN_API_KEY=your_langsmith_api_key
LANGSMITH_TRACING=true

OPENAI_API_KEY=your_openai_api_key

Then, install dependencies and run the eval!

yarn install
yarn run eval

For more instructions on getting set up with LangSmith's Vitest runner, see the docs here.

For more on what's available in openevals, see the README on npm.