support for Litellm module and Azure , aws OCR modules
Closed this issue · 2 comments
please provide supprot for
support for Litellm module and Azure , aws OCR modules
Thanks for taking the time to leave a comment, unfortunately integrating proprietary OCR modules is beyond the scope of this library. I don't think open-parse would add much values on top of those solutions anyways.
Hi @Filimoa,
I would like to suggest adding support for Litellm.
Litellm is an open source project, which unifies the API call of 100+ LLMs (including Anthropic, Cohere, and Ollama, etc) in an OpenAI compatible format: https://github.com/BerriAI/litellm
I believe integrating Litellm would be a fantastic enhancement because people could choose to switch or use their preferred embedding model api instead of OpenAI's ones only when dealing with semantic processing. Thanks.
For example, if they used litellm python client and without self hosting litellm proxy, then their code could be like this (which is very consistent with OpenAI python client format):
Reference: https://github.com/BerriAI/litellm
if someone self hosted litellm proxy, which they can call LLM API in an OpenAI compatible format via llmlite proxy, you could see the code could be as follows:
