/talktolisten-LLM-prod

LLM Deployment

Primary LanguagePythonApache License 2.0Apache-2.0

Talk To Listen LLM Deployment

  • Talk To Listen LLM is deployed on Runpod serverless using Docker.
  • The model is a fine-tuned from opensource model TheBloke/Mistral-7B-Instruct-v0.2-GPTQ using QLoRA and Supervised Learning. on the Talk To Listen dataset.