microsoft/rag-experiment-accelerator
The RAG Experiment Accelerator is a versatile tool designed to expedite and facilitate the process of conducting experiments and evaluations using Azure Cognitive Search and RAG pattern.
PythonNOASSERTION
Issues
- 1
- 0
rag-experiment-accelerator package installation fails on PromptFlow due to dependency conflicts
#755 opened by KKulma - 0
[peer-review-pal] Repository Review for Commit #290bd0ecdde69903f6792d281f4afc6e6604f09c
#754 opened by julia-meshcheryakova - 1
enable image and table data ingestion, indexing and search as part of Multi-modal RAG
#703 opened by ritesh-modi - 0
Add source to pdf doc metadata
#735 opened by beandrad - 0
pip install custom_environment/rag_experiment_accelerator-0.9-py3-none-any.whl fails
#734 opened by KKulma - 0
- 0
Read a PDF file and if it has images then it should be converted into embededdings and stored with AI Search
#725 opened by ritesh-modi - 1
Test Extracting a table from a PDF
#729 opened by letemptt - 0
Evaluate Unstructured PDF Reader Library
#727 opened by letemptt - 1
add new Search Features like Filtering,(pre, post), generate dynamic rich metadata (like summary, title, keywords, entities etc) along with usage of Query Profiles
#685 opened by ritesh-modi - 1
- 0
- 1
PRs from Forks won't have Access to Secrets
#452 opened by martinpeck - 0
Enforce json schema for config.json
#543 opened by guybartal - 0
Log all config hyper parameters to mlflow tags
#480 opened by guybartal - 0
Add bicep code for Azure Document Intelligence.
#448 opened by shivam-51 - 0
Bring better Q&A generation capabilities
#505 opened by quovadim - 0
Modularize REA repository
#524 opened by Lep06fg - 0
index_name is cut off to 128 characters
#684 opened by julia-meshcheryakova - 1
Reconstruct CI/CD pipeline for different scenarios including local and Azure ML execution
#522 opened by Lep06fg - 0
Integrate the best experiment (prompt Flow) with LLMOps for automated deployment
#669 opened by ritesh-modi - 0
Scenario based sample evaluation
#526 opened by Lep06fg - 0
Scenario based sample configuration
#525 opened by Lep06fg - 0
Add RAFT capabilities, fine-tuning and inference
#527 opened by Lep06fg - 0
Generate Prompt Flow inference pipeline based on the best experiment configuration
#668 opened by ritesh-modi - 0
- 0
Extend metric reporting such that confidence intervals are also computed and displayed. Confidence interval computation should leverage recent frameworks like prediction-powered inference to combine AI-based metrics (like LLM-based metrics) with human evaluations.
#597 opened by dmavroeid - 0
Implement appropriate methods that can estimate confidence intervals for metrics leveraging recent methods for combining AI-based metrics with human annotations
#596 opened by dmavroeid - 0
Add groundedness evaluation metric
#573 opened by kcortinas - 1
- 0
Implementing Checkpoints for Azure ML
#491 opened by yuvalyaron - 1
- 0
Documentation around why SpacyEvaluator is used
#551 opened by pkt1583 - 0
Separate each search type into its own mlflow run to allow comparison using Azure ML / mlflow
#540 opened by guybartal - 1
Table Chunking
#432 opened by Lep06fg - 0
Custom PdfLoader implementation support
#539 opened by pkt1583 - 0
- 0
Set up secrets for Dependabot
#455 opened by julia-meshcheryakova - 0
- 0
- 0
- 0
Azure CLI Deployment Example Error
#486 opened by andrewDoing - 1
02_qa_generation fails with exception
#485 opened by seekerofsai - 0
- 0
Adding Checkpoint usage to additional steps (already implemented for 01_index)"
#490 opened by yuvalyaron - 0
Make current preprocess step optional
#451 opened by guybartal - 0
- 0
- 0
AzureML pipeline: Add step for qna generation
#435 opened by tanya-borisova