/llm-project-quickstart

quicktart template for LLM projects. includes useful tools, logging, cost tracking etc, v easy

Primary LanguagePython

LLM Project Quickstart (v1.0)

quicktart template for LLM projects. includes useful tools, logging, cost tracking etc, v easy

image

SETUP

  1. rename .env-template to .env and fill in your openai keys, bedrock keys, etc
  2. run pip install -r requirements.txt
  3. modify/run example.py

image

supported models

OpenAI Bedrock Anthropic
gpt-4o bedrock-haiku anthropic-haiku
gpt-3.5-turbo bedrock-opus anthropic-opus
bedrock-sonnet anthropic-sonnet
bedrock-sonnet3.5 anthropic-sonnet3.5

support

raise an issue here or DM me on twitter @dnbt777