Ollama-js-tutorial

Ollama using JavaScript

New install

Clone this repo:

# Downlaod the repo.
git clone https://github.com/felixdrp/ollama-js-tutorial.git

# Go to the new install folder.
cd ollama-js-tutorial

Refresh your repo

# Go to your ellama-js-tutorial folder
cd ollama-js-tutorial

# Get the last version of this repo
git pull --autostash

# Install the new dependencies:
bun install

If git is not installed, then install git.

Bun (JavaScript Runtime)

Bun is an all-in-one JavaScript runtime & toolkit designed for speed, complete with a bundler, test runner, and Node.js-compatible package manager.

Install Bun

Install options:

Linux or Mac

curl -fsSL https://bun.sh/install | bash

Mac using brew

brew install oven-sh/bun/bun # for macOS and Linux

If you don't have brew installed:

/bin/bash -c "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/HEAD/install.sh)"

Windows

powershell -c "irm bun.sh/install.ps1 | iex"

Ollama (Run large language models)

Install options:

Direct install of Ollama
Container version of Ollama (container)
- You NEED a container provider like docker or podman. Install docker.
- Multiple container alternatives like CPU (default), Nvidia and AMD GPU rocm. For GPU you NEED docker.

General Ollama docs.

Install a model

Install Llama3.1:

# Direct install 
ollama run llama3.1

Install on a container:

docker exec -it ollama ollama run llama3.1

List models

# Direct install 
ollama list
# Container version
docker exec -it ollama ollama list

Install Javascript Packages

After we cloned the repository we need to install the project packages.

bun install

Run examples

If you use Ollama on a container, please, run the container before running the examples.

Model prompting

bun src/prompting.js

Web prompting using on memory RAG ()

# From a file. Example uses llama3.2:3b model
bun src/text-retrieval.js
# From a web page.
bun src/web-retrieval.js

Prompting using an image

# Example file needs minicpm-v model.
bun src/query-image.js media/576px-Pennywell_Farm_is_home_to_some_beautiful_Highland_Cows.jpg

felixdrp/ollama-js-tutorial