Add support for more models and knowledge base
Opened this issue · 2 comments
abhijithneilabraham commented
Currently LLamaindex and AzureOpenAI are being used to support LLM Apis, but this module could be extended larger than this, giving support also for open source models. We need a base class to be written for integration to such APIs.
Govind-S-B commented
Using a project like LiteLLM can reduce the hassle of producing a base class , since LiteLLM can override it and use the openai standard API while extending support to multiple backends
abhijithneilabraham commented
Thanks!