LLM Test Harness

  1. Create a new project with
npx promptfoo@latest init
  1. Edit the promptfooconfig.yaml file, with your desired configuration like providers, prompts, etc. Then run:
npx promptfoo@latest eval
  1. Optionally, you can view the results by running
npx promptfoo@latest view