What are the problems?(screenshots or detailed error messages)
What are the types of GPU/CPU you are using?
What's the operating system ppl.llm.serving runs on?
What's the compiler and its version?
Which version(commit id or tag) of ppl.llm.serving is used?
What are the commands used to build ppl.llm.serving?
What are the execution commands?
minimal code snippets for reproducing these problems(if necessary)
models and inputs for reproducing these problems (send them to openppl.ai@hotmail.com if necessary)