/llm-deck

lets you see responses from multiple LLMs at once.

Primary LanguageTypeScriptApache License 2.0Apache-2.0

LLM Deck

This application enables simultaneous viewing of responses from multiple large language models (LLMs).

Features:

  • Display responses in either raw text or Markdown format, enhanced with TeX support.
  • Convert responses to speech in real-time using AWS Polly, selecting the appropriate voice for the language.

DEMO SITE

How to use

  1. First, enter your API keys in the "credential" field.

    Your information will be stored ONLY in your browser's localStorage and will NEVER be sent to the host. However, avoid using untrusted hosts.

  • GPT4(OpenAI): OPENAI_API_KEY
  • Gemini(Google): ACCESS_KEY
  • Claude(AWS Bedrock): AWS_REGION:AWS_ACCESS_KEY_ID:AWS_SECRET_ACCESS_KEY (colon separeted)
  1. Type your question or command, then click 'Send' on the right to receive the response.

Development

To set up the development environment:

  • Add your API keys to the .env file to overwrite values in the localStore.
cp .env.sample .env

# Set your API keys in .env

npm install

npm run dev

# Open your browser and go to http://localhost:5173