PromptFoo Minimal Example

THis is a repository to show how to use PromptFoo to create a minimal example of evaluation of multiple prompts for a ollama llm.

Installation

Install Node Js.

Using npx:

npx promptfoo@latest
npx promptfoo@latest eval
npx promptfoo@latest view

Data

The dataset used is the Samples of electronic Invoices Dataset from Mendeley Data. The dataset ist available here: https://data.mendeley.com/datasets/tnj49gpmtz/2 and licenced under CC BY 4.0.