Implementation of Model-Distributed Inference for Large Language Models, built on top of LitGPT
Primary LanguagePythonMIT LicenseMIT
No one’s star this repository yet.