/llama2.go

Inference Llama 2 in one file of pure go

Primary LanguageGoMIT LicenseMIT

llama2.go

A golang reimplementation of llama2.c, with OpenCL support.

Usage

# download model.bin and tokenizer.bin to _output from
# https://github.com/karpathy/llama2.c

make
cd _output
./llama2 run