aayushsss1/WikiSpeaks

Project Checklist

Closed this issue · 0 comments

aayushsss1 commented
  • KServe Llama deployment
  • Wikipedia API
  • Persisting in Faiss using ray
  • Prompt using OpenAI API Client for vLLM runtimes
  • Streamlit UI
  • Monitoring