To get started, set your Langsmith API key and OpenAI API key in a new .env file:
LANGCHAIN_API_KEY=your_langsmith_api_key
LANGSMITH_TRACING=true
OPENAI_API_KEY=your_openai_api_keyThen, install dependencies and run the eval!
yarn install
yarn run evalFor more instructions on getting set up with LangSmith's Vitest runner, see the docs here.
For more on what's available in openevals, see the README on npm.