uptrain-ai/uptrain
UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.
PythonApache-2.0
Issues
- 1
Custom Prompts -Example clarification
#711 opened by terry07 - 0
Experiments page not getting rendered
#739 opened by rahulkrprajapati - 0
- 0
- 2
Issue Creating new project
#697 opened by chiragksharma - 0
using custom llm
#735 opened by shazil-ahmed - 6
Azure LLM evaluation - Deployment Error
#682 opened by meenusel - 0
- 1
- 1
- 0
- 1
- 0
Better Few shot examples for prompt injection eval
#529 opened by sourabhagr - 1
Response Matching requires context field because the field gets dropped by polars
#724 opened by DevTimBo - 0
Polars version
#727 opened by terry07 - 0
Error when processing payload
#725 opened by Breamer - 0
Error when sending request to LLM API: Task got bad yield: WaitTaskRescheduled(abort_func=<function sleep_forever.<locals>.<lambda> at 0x1413db380>)
#715 opened by gokturkDev - 0
- 1
Use Local LLM
#698 opened by philipchung - 2
docker image to multi architecture
#691 opened by DrinkingMilktea - 4
- 0
llama.cpp local eval support
#686 opened by lbux - 3
Too many values to unpack (resp_text.split)
#615 opened by lbux - 12
- 1
Return tokens count/cost for checks
#656 opened by ssaha1567 - 2
FastAPI deployment
#654 opened by HasnainKhanNiazi - 2
Support for LLMs hosted on AWS Bedrock
#589 opened by bithikaj - 1
Support for LLMs running on Vertex AI
#641 opened by verdverm - 1
Update the Integrations table in README.md
#624 opened by Dominastorm - 0
Create a Use Case Example
#522 opened by Dominastorm - 9
- 0
Revise the API Reference documentation
#521 opened by Dominastorm - 1
Update test_builtins.py
#520 opened by Dominastorm - 1
Ollama integration
#514 opened by sourabhagr - 1
Gemma Integration
#554 opened by Dominastorm - 0
Add an operator to compute MT-Bench
#605 opened by Dominastorm - 0
Mamba Integration
#604 opened by Dominastorm - 1
- 1
New Project missing .jsonl file will not indicate it as a required file on Safari
#600 opened by cfrenchi - 1
Fresh venv install following the Quickstart example fails due to ModuleNotFoundError: No module named 'fsspec'
#599 opened by cfrenchi - 1
Mistral Endpoint Integration
#513 opened by sourabhagr - 1
Fix Jailbreak detection tutorial variable name
#579 opened by anas-rabhi - 1
Add test data for conversation evals
#540 opened by sourabhagr - 1
Add data for response matching eval
#542 opened by sourabhagr - 0
Add an operator to compute MMLU score
#557 opened by Dominastorm - 1
Together AI Integration
#512 opened by sourabhagr - 0
- 0
Modularize the operators
#532 opened by Dominastorm - 0
- 0
Fix the schema for conversation evals
#530 opened by sourabhagr