/simple-llm-ui

Simple LLM UI with LangServe

Primary LanguageJavaScript

A simple UI setup for local LLM

Repo for an example to build very simple chatbot UI using LangChain.

Chatbot Server

Install Ollama and install llama3.

LangChain Server

Requirements

  • Runtime: Python 3.10+

Execution

  1. Create virtual environment.
python3 -m venv .env
  1. Enter the LangChain project.
cd langchain
pip install -r requirements.txt
  1. Run the LangChain server (http://localhost:8000).
python main.py

UI

Requirements

  • Web-Server: node 16+
  • Web-Browser: latest version of Edge / Chrome / Firefox

Execution

  1. Start web server
cd ui
node server.js
  1. Visit http://localhost:8001.