/llm-hosting-container

Large Language Model Hosting Container

Primary LanguageDockerfileApache License 2.0Apache-2.0

LLM Hosting Container

Welcome to the LLM Hosting Container GitHub repository!

This repository contains Dockerfile and associated resources for building and hosting containers for large language models.

  • HuggingFace Text Generation Inference (TGI) container

Security

See CONTRIBUTING for more information.

License

This project is licensed under the Apache-2.0 License.