silavsale/Ollama-React

Running Qwen2.5-Coder:7b with Ollama

This guide shows how to run the Qwen model using the Ollama model management tool.

By default to interact with the model, the user needs to use the terminal, I will try to create and attach the UI to interact with the model using GUI,

1. Pull the Ollama Docker Image

docker pull ghcr.io/jmorganca/ollama:latest

2. Set Up a Persistent Volume

mkdir -p ~/.ollama/models

3. Run Ollama in a Container

docker run -it --rm \
    -p 11411:11411 \
    -v ~/.ollama:/root/.ollama \
    ghcr.io/jmorganca/ollama:latest bash

4. Download the Qwen2.5-Coder:7b Model

ollama pull qwen2.5-coder:7b

5. Run the Model

ollama run qwen2.5-coder:7b

GPU Acceleration (Optional)