uptrain-ai/uptrain

Support to use locally hosted HuggingFace LLMs as an evaluator

Opened this issue · 0 comments

Is your feature request related to a problem? Please describe.
Can we add support to host our own LLMs using HuggingFace LLMs via Langchain as evaluator instead of using API Keys of publicly hosted LLMs?

Describe the solution you'd like
No need to rely on publicly hosted open source API keys rather use own hosted LLMs inside AWS Sagemaker etc.

Describe alternatives you've considered
Considered using Ragas, DeepEval which provides this functionality.

Thank you for your feature request - We love adding them