/ollama-qwen2.5-coder-7b

Primary LanguageDockerfile

Ollama Qwen2.5-Coder (7b)

This README provides instructions for building and running the Ollama Qwen2.5-Coder:7b model Docker container and using Lilypad CLI for running on the Lilypad network.

Prerequisites

  • Docker installed on your system
  • GPU
  • Lilypad CLI installed (for Lilypad network runs)

Building and Running with Docker

  1. Open a terminal and navigate to the directory containing the Dockerfile.

  2. Build the Docker image:

    docker build -t ollama-qwen2.5-coder-7b .

  3. Run the container:

    Basic run with GPU support:

    docker run --gpus all ollama-qwen2.5-coder-7b "your prompt here"

Running on Lilypad Network

Using Lilypad LocalNet

To run on the local development network:

go run . run --network dev github.com/rhochmayr/ollama-qwen2.5-coder-7b:1.0.0 --web3-private-key <private-key> -i Prompt="your prompt here"

Replace <admin_key> with the admin key found in hardhat/utils/accounts.ts.

Example:

go run . run --network dev github.com/rhochmayr/ollama-qwen2.5-coder-7b:1.0.0 --web3-private-key <private-key> -i Prompt="write a quick sort algorithm"

Using Lilypad Main Network

To run on the main Lilypad network:

lilypad run github.com/rhochmayr/ollama-qwen2.5-coder-7b:1.0.0 -i Prompt="your prompt here"

Example:

lilypad run github.com/rhochmayr/ollama-qwen2.5-coder-7b:1.0.0 -i Prompt="write a quick sort algorithm"

Notes

  • Ensure you have the necessary permissions and resources to run Docker containers with GPU support.
  • The module version (1.0.0) may be updated. Check for the latest version before running.

Dependencies and Credits