TonicAI/tonic_validate
Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.
PythonMIT
Issues
- 0
Support ndcg metric for contexts ranking
#230 opened by ycjcl868 - 0
Integration with Ragas in not working
#222 opened by Jeerhz - 0
Running local LLM with tonic_validate_evaluator
#218 opened by SalwaMostafa - 1
ragas.evaluate() throws "AttributeError: 'TestDataset' object has no attribute 'rename_columns'."
#203 opened by bachlipp - 2
TypeError: collect_dataclass_fields() got an unexpected keyword argument 'config_wrapper'
#180 opened by farzad528 - 1
Max Amount of Ground Truth Values
#196 opened by farzad528 - 1
ModuleNotFoundError
#166 opened by Timmy-485 - 2
Support history display in tonic_validate UI
#143 opened by chansonzhang - 0
Expose LLM Evaluator Prompts
#21 opened by joeferraratonic - 1
Other Metrics
#73 opened by adorosario - 0
- 0
Support fine-grained metrics
#150 opened by peter-did-mh - 4
Add support for google models
#114 opened by mafaldcostad - 2
Retrieval precision
#145 opened by bellyqpp - 4
Unable to fetch project runs
#125 opened by chansonzhang - 0
- 0
Add support for run tags
#113 opened by akamor - 1
ModuleNotFoundError: No module named 'async_lru'
#109 opened by Timmy-485 - 3
Request for OpenAI Assistant Examples
#91 opened by williamzebrowskI - 0
Add metrics for detecting PII
#93 opened by akamor - 0
Metric classes for metrics that do and do not use LLM assisted evaluation
#86 opened by joeferraratonic - 1
Validate Score Values
#22 opened by joeferraratonic - 0
Config runs on import
#71 opened by ethan-tonic - 0
Detect Validate GH Actions
#63 opened by ethan-tonic - 0
Detect CI/CD
#64 opened by ethan-tonic - 0
Fix imports to include new classes
#58 opened by ethan-tonic - 0
- 0
Make PyPi README match Github
#52 opened by ethan-tonic - 2
Add Telemetry
#46 opened by ethan-tonic - 3
When OpenAI evaluator errors out sometimes, the integrity of the entire benchmark results come into question
#36 opened by adorosario - 0
Update LlamaIndex quickstart notebook
#50 opened by joeferraratonic - 0
Blog Post notebook for OpenAI Rag vs Google Vertex
#48 opened by akamor - 3
- 0
Have only one paul_graham_essays folder
#43 opened by joeferraratonic - 2
Anti-Hallucination Score - Switched?
#37 opened by adorosario - 0
Bump version number for release.
#41 opened by joeferraratonic - 1
Python3.8 imcompatible typing
#35 opened by logan-markewich