dotneet/smart-chatbot-ui

Reduce costs by limiting to only past 2 messages from history

Opened this issue · 1 comments

ofirkris commented

Currently the entire conversations context is sent to OpenAI API which causes high costs per GPT4 query, how can we limit the context to only last two messages?

fbaptista commented

If you want to avoid sending the entire context, what about just starting a new conversation?

  • 👍1