/golang-llm-server

This is a simple server to test out the applications of llm's

Primary LanguageGoOtherNOASSERTION

golang-llm-server

This is a simple server to test out the applications of llm's

Steps to set this project up

  1. Setup Config management
  2. Build server
  3. Create LLM client
  4. Create Hugging face client
  5. Create Vector db client
  6. Create Langchain
  7. Build endpoint for answering questions