gpu inference
ziliangpeng opened this issue · 1 comments
ziliangpeng commented
can you merge this to enable gpu inference? ggerganov/llama.cpp#1642
fredi-python commented
thx for letting me now!
merged.
ziliangpeng opened this issue · 1 comments
can you merge this to enable gpu inference? ggerganov/llama.cpp#1642
thx for letting me now!
merged.