karpathy/llama2.c

llama2_7b_chat have no any response

s348268281 opened this issue · 1 comments

s348268281 commented

I use mbp M1,when I run the code : ./run llama2_7b_chat.bin -m chat
I waited for a long time without any response
image
image

I'm too low or my reasoning is slow？

s348268281 commented

I use mbp M1,when I run the code : ./run llama2_7b_chat.bin -m chat I waited for a long time without any response image image

I'm too low or my reasoning is slow？

It seems that the cpu inference is really slow, and I waited for an hour to have a few responses