/gpt_llm

Multi-GPU setup for inference with GPT NeoX 20B and OPT-30B models in huggingface

Primary LanguagePythonGNU Affero General Public License v3.0AGPL-3.0

Issues