ufssd/LLM_intro-workshop

Game Plan

• Transformer architecture overview
• Using LLMs
  • API hosted
    • litellm
    • braintrust
  • Locally Hosted
    • Ollama
    • Huggingface
    • Pytorch
• Evaluating LLMs
  • Existing common evaluations
    • MT-Bench
    • AlpacaEval
  • Creating your evaluation
• Deploying LLMs
  • Deploy to the huggingface API
  • OpenAI completions standard