Claude 2 Anthropic Support
bhctest123 opened this issue · 3 comments
It would be awesome to support claude 2! the 100k context window is amazing.
You could implement this and solve it across many LLMs: https://github.com/BerriAI/litellm
I'm the maintainer of liteLLM - happy to make a PR and add an integration😊
At the moment, I am unable to see Claude being utilized to facilitate completions on Langchain. Nevertheless, Langchain does provide a Chat API as detailed here: https://python.langchain.com/docs/integrations/llms/. On the other hand, Claude's support for completions is available on Llama Index, so experimenting with that option could be worthwhile.
ChatLiteLLM() is integrated into langchain and allows you to call all models using the OpenAI I/O interface
https://python.langchain.com/docs/integrations/chat/litellm