orangewise/aws-genai-llm-chatbot

A modular and comprehensive solution to deploy a Multi-LLM and Multi-RAG powered chatbot (Amazon Bedrock, Anthropic, HuggingFace, OpenAI, AI21, Cohere) using AWS CDK on AWS

Deploying a Multi-Model and Multi-RAG Powered Chatbot Using AWS CDK on AWS

Full documentation

This solution provides ready-to-use code so you can start experimenting with a variety of Large Language Models and Multimodal Language Models, settings and prompts in your own AWS account.

Supported model providers:

• Amazon Bedrock
• Amazon SageMaker self-hosted models from Foundation, Jumpstart and HuggingFace.
• Third-party providers via API such as Anthropic, Cohere, AI21 Labs, OpenAI, etc. See available langchain integrations for a comprehensive list.

Authors

• Bigad Soleiman
• Sergey Pugachev

Credits

This sample was made possible thanks to the following libraries:

• langchain from LangChain AI
• unstructured from Unstructured-IO
• pgvector from Andrew Kane

License

This library is licensed under the MIT-0 License. See the LICENSE file.

• Changelog of the project.
• License of the project.
• Code of Conduct of the project.
• CONTRIBUTING for more information.