microsoft/Llama-2-Onnx

7B_FT_float16 model size

sania96 opened this issue · 3 comments

Hi,
i am downloading 7B_FT_float16 model, and this is still downloading when it is of 10gb, can you please tell me how much will be its exact size?
Thanks.

12.8 GB

12.8 GB

Hi, downloaded the model successfully!
but now when i am running the example file, it keeps on running and a cursor is showing on cmd...it is not showing any error or anyhting.

What environment are you running it in?

I am having the same issue, running from anaconda / conda. CUDA 11.8
Maybe relates to this #25