/InferLLM

a lightweight LLM model inference framework

Primary LanguageC++Apache License 2.0Apache-2.0

Stargazers