LLMStack is a no-code platform for building generative AI applications, chatbots, agents and connecting them to your data and business processes.
Build tailor-made generative AI applications, chatbots and agents that cater to your unique needs by chaining multiple LLMs. Seamlessly integrate your own data and GPT-powered models without any coding experience using LLMStack's no-code builder. Trigger your AI chains from Slack or Discord. Deploy to the cloud or on-premise.
Check out our Cloud offering at Promptly or follow the instructions below to deploy LLMStack on your own infrastructure.
Clone this repository or downoad the latest release. Copy .env.prod to .env and update SECRET_KEY, CIPHER_SALT and DATABASE_PASSWORD in .env file:
cp .env.prod .env
Run LLMStack using the following command:
./run-llmstack.sh
Once LLMStack is up and ready, it should automatically open your browser and point it to localhost:3000. You can also alternatively use docker compose up to manually start the containers and open localhost:3000 to login into the platform. Make sure to wait for the API server to be ready before trying to load LLMStack.
LLMStack deployment comes with a default admin account whose credentials are admin and promptly. Be sure to change the password from admin panel after logging in.
Users of the platform can add their own keys to providers like OpenAI, Cohere, Stability etc., from Settings page. If you want to provide default keys for all the users of your LLMStack instance, you can add them to the
.envfile. Make sure to restart the containers after adding the keys.
Remember to update
POSTGRES_VOLUME,REDIS_VOLUMEandWEAVIATE_VOLUMEin.envfile if you want to persist data across container restarts.
🔗 Chain multiple models: LLMStack allows you to chain multiple LLMs together to build complex generative AI applications.
📊 Use generative AI on your Data: Import your data into your accounts and use it in AI chains. LLMStack allows importing various types (CSV, TXT, PDF, DOCX, PPTX etc.,) of data from a variety of sources (gdrive, notion, websites, direct uploads etc.,). Platform will take care of preprocessing and vectorization of your data and store it in the vector database that is provided out of the box.
🛠️ No-code builder: LLMStack comes with a no-code builder that allows you to build AI chains without any coding experience. You can chain multiple LLMs together and connect them to your data and business processes.
☁️ Deploy to the cloud or on-premise: LLMStack can be deployed to the cloud or on-premise. You can deploy it to your own infrastructure or use our cloud offering at Promptly.
🚀 API access: Apps or chatbots built with LLMStack can be accessed via HTTP API. You can also trigger your AI chains from Slack or Discord.
🏢 Multi-tenant: LLMStack is multi-tenant. You can create multiple organizations and add users to them. Users can only access the data and AI chains that belong to their organization.
Using LLMStack you can build a variety of generative AI applications, chatbots and agents. Here are some examples:
📝 Text generation: You can build apps that generate product descriptions, blog posts, news articles, tweets, emails, chat messages, etc., by using text generation models and optionally connecting your data. Check out this marketing content generator for example
🤖 Chatbots: You can build chatbots trained on your data powered by ChatGPT like Promptly Help that is embedded on Promptly website
🎨 Multimedia generation: Build complex applications that can generate text, images, videos, audio, etc. from a prompt. This story generator is an example
🗣️ Conversational AI: Build conversational AI systems that can have a conversation with a user. Check out this Harry Potter character chatbot
🔍 Search augmentation: Build search augmentation systems that can augment search results with additional information using APIs. Sharebird uses LLMStack to augment search results with AI generated answer from their content similar to Bing's chatbot
💬 Discord and Slack bots: Apps built on LLMStack can be triggered from Slack or Discord. You can easily connect your AI chains to Slack or Discord from LLMStack's no-code app editor. Check out our Discord server to interact with one such bot.
Login to http://localhost:3000/admin using the admin account. You can add users and assign them to organizations in the admin panel.
Check out our cloud offering at Promptly. You can sign up for a free account and start building your own generative AI applications.
Check out our documentation at llmstack.ai/docs to learn more about LLMStack.
Remember to run
npm run buildbefore starting your containers for development. Make sure to runnpm installin the client directory before runningnpm startornpm run build.
Run docker compose -f docker-compose.dev.yml --env-file .env.dev up to start the containers in development mode. This will mount the source code into the containers and restart the containers on code changes. Update .env.dev as needed. Please note that LLMStack is available at http://localhost:9000 in development mode.
For frontend development, you can use npm start to start the development server in client directory. You can also use npm run build to build the frontend and serve it from the backend server.
To update documentation, make changes to web/docs directory and run npm run build in web directory to build the documentation. You can use npm start in web directory to serve the documentation locally.
We welcome contributions to LLMStack. Please check out our contributing guide to learn more about how you can contribute to LLMStack.
LLMStack is licensed under the Elastic License (ELv2).