/crash

This crashes something somewhere

Primary LanguageCMIT LicenseMIT

crash - This llama.cpp setup crashes something somewhere

Steps

  1. Build docker image
git clone https://www.github.com/preciz/crash
cd crash
wget 'https://huggingface.co/TheBloke/Llama-2-7B-GGML/resolve/main/llama-2-7b.ggmlv3.q4_K_M.bin'
docker build . -t embedding
  1. Install Elixir for the stress test scripts:
pacman -S elixir
  1. Run the stress test
elixir start.exs