llm-test

There are 8 repositories under llm-test topic.

  • uptrain-ai/uptrain

    UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.

    Language:Python2.1k20135171

  • georgian-io/LLM-Finetuning-Toolkit

    Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.

    Language:Python709144784

  • JohnSnowLabs/langtest

    Deliver safe & effective language models

    Language:Python4641141334

  • athina-ai/athina-sdk

    LLM Testing SDK that helps you write and run tests to monitor your LLM app in production

    Language:Python129211

  • levitation-opensource/Manipulative-Expression-Recognition

    MER is a software that identifies and highlights manipulative communication in text from human conversations and AI-generated responses. MER benchmarks language models for manipulative expressions, fostering development of transparency and safety in AI. It also supports manipulation victims by detecting manipulative patterns in human communication.

    Language:HTML7302

  • Coldwave96/LLM-Sec-Evaluation

    Scripts for evaluating LLM security abilities.

    Language:Python4202

  • awesome-software/nlptest

    Deliver safe & effective language models

    Language:Python1000

  • awesome-software/promptfoo

    Test your prompts. Evaluate and compare LLM outputs, catch regressions, and improve prompt quality.

    Language:TypeScript00