php-llm/llm-chain

Examples as E2E Tests

chr-hertel opened this issue · 5 comments

chr-hertel commented

Would be interesting to run the examples as E2E tests. Would require tokens (not that problematic with secrets i guess) but also a clever way to execute and run assertions.

Maybe it's enough to have a proper exit code? 🤔

OskarStark commented

What about prompting "Answer just with: OK" or a structured output?

chr-hertel commented

Answer just with: OK

Huh, easy one - i Like 👍

  • 😄1
chr-hertel commented

after integrating the example runner, this is not that urgent anymore, but basically that thing could be converted to a functional phpunit test - only important to execute those example parallel not sequentially

  • 👍1