- Build docker image
git clone https://www.github.com/preciz/crash
cd crash
wget 'https://huggingface.co/TheBloke/Llama-2-7B-GGML/resolve/main/llama-2-7b.ggmlv3.q4_K_M.bin'
docker build . -t embedding
- Install Elixir for the stress test scripts:
pacman -S elixir
- Run the stress test
elixir start.exs