FMInference/FlexLLMGen

flexgen without GPU?

Opened this issue · 0 comments

Hi!
Is it possible to use flexgen without any GPU?
Something like --percent 0 100 0 100 0 100
Now I have error RuntimeError: Found no NVIDIA driver on your system.

I do not have any GPU but have a lot of cpu cores.