Issues
- 0
- 0
Add ability to bust cache from the web UI
#856 opened by chrismaltais - 1
- 0
- 0
- 2
Support `systemInstruction` for Gemini (PALM)
#837 opened by YiFanChen99 - 1
- 1
- 3
Allow options to avoid using special characters
#843 opened by shuaiwangdd - 3
- 4
- 1
Individual external Python assertion that raises exception results in no grading result in JSON output
#827 opened by efung - 2
promptfoo 0.60.0 --share not working
#832 opened by JiajunZhou-ws - 1
- 0
Using vars on rubricPrompt lacks serialization, leading to the failure of the entire assertion.
#823 opened by YiFanChen99 - 2
- 0
- 4
Use test vars in function schema
#775 opened by tomquist - 1
- 7
- 4
Only most recent Eval is viewable in the WebViewer - Failed to execute 'setItem' on 'Storage'
#802 opened by CMelnickEngageware - 0
Web ui doesn't support object prompts config
#803 opened by kongmoumou - 0
How can we secure self hosted promptfoo server?
#801 opened by harshaa947 - 1
- 6
- 2
- 3
- 2
- 3
In the html report (view/shared), instruction tokens and completion tokens should be shown separately.
#793 opened by harsh-writesonic - 2
No Amazon Bedrock models can be used as embedding providers for similarity assertion
#795 opened by markstownsend - 1
How to test prompt with triple dashes inside without breaking into separate prompts?
#789 opened by SamComber - 2
- 0
- 1
Browser exception (Minified React error #31; visit) when clicking magnifying glass in output
#768 opened by efung - 3
Description Field in Test.yaml Causes Assertions to Pass Incorrectly
#767 opened by SimonPringleWallace - 2
Request: support `--max-concurrency=auto`
#737 opened by jamesbraza - 2
- 3
Feature Request: Assertion Sets
#757 opened by thomascleberg - 0
Feature Request: Have optional vars in assertions with ability to define fallbacks
#766 opened by reallyinvincible - 0
- 1
Shouldn't "gemini-1.5-pro-latest" be named "gemini-1.5-pro-preview-0409"?
#760 opened by StephanSchuster - 0
not-equals is not working
#762 opened by ekrobj - 4
CORS error when using self hosted server
#743 opened by NathanKarthik1996 - 3
- 1
add evalId in generate OutputFile
#752 opened by pelikhan - 2
pass logger as callApi
#746 opened by pelikhan - 1
- 1
Random sampling of n data rows
#740 opened by alexclaydon - 0
- 1
Docs request: where does histogram come from?
#738 opened by jamesbraza