dvantuyl/ai-platform-demo

Minimal Platform for experimenting with AI

Ai Platform Demo

This is a demo platform for building Ai powered user interfaces.

Start

1. Install Ollama and pull in the model weights for phi3 & llama3:instruct 1a. Serve Ollama in the background at address http://localhost:11434
2. bundle install
3. x/serve
4. Open your browser to https://localhost:9292/

Note: The first web-socket handshake will error due to browser not liking our self-signed SSL certificate. Ignore warning for now and let the browser access your site.

Stack

Web Service

• Roda: Ruby Minimal Web Framework
• Falcon: Async web server provides web sockets

LLM

• Ollama: LLM Service
• internlm: Chinese functional calling llm
• phi3: Microsoft LLM
• llama3:instruct Meta LLM

UI

• HTMX: Page interactivity w/o javascript
• Web Awesome: UI Web Components

Reference

• interalm2 | chat format
• ollama | api
• Allow chrome to accept self signed certs