https://huggingface.co/anon8231489123/vicuna-13b-GPTQ-4bit-128g/discussions/34
docker build . -t v13b
docker run -p 5000:5000 -p 5005:5005 -p 7860:7860 --gpus all -it v13b
Visit http://localhost:7860/
rascal999/vicuna-13b-docker
https://huggingface.co/anon8231489123/vicuna-13b-GPTQ-4bit-128g/discussions/34
Dockerfile