randaller/llama-chat

OOM with 64G ram and 13B model

Closed this issue · 2 comments

dunkean commented

Is this memory print normal ? I hoped at least the 13B model could work ?

randaller commented

@dunkean try to increase swap file size a bit

dunkean commented

Thank you ! problem solved.

  • 👍1