ai-genie/chatgpt-vscode

Can't properly rewind conversation (e.g. edit conversation from 4 turns ago) like I can with other AI plugins

mdrejhon opened this issue · 0 comments

Describe the Bug

Latest VS Code

Please tell us if you have customized any of the extension settings or whether you are using the defaults.

  1. Use GPT4 Turbo (gpt-4-1106-preview) with large context windows
  2. Have a long conversation, like pasting whole code modules and asking questions about it / asking for ES6 compatibility / anything that might not work in Safari / etc (10KB-50KB code pastes are routine now)
  3. Scroll back at least two turns ago.
  4. Edit the query.
  5. It promptly forgets the current conversation. It is not as if you rewound the conversation.

On the paid ChatGPT 4, you can easily "rewind" a conversation (like pressing a rewind button a human coding pair assistant, to rephrase your question) simply by scrolling and editing an old question. It's as if you press the rewind button, promptly forgetting ONLY what came after, and remembering EVERYTHING that came before. But ai-genie promptly forgets context, if I edit-resend a earlier request, and it gets confused.

I've been using it as a code tutor, and the benefit of rewinding a conversation to get things back on track, is a hallmark of a good general-purpose AI. But it's not working properly.

Additional context

gpt-4-1106-preview (GPT4 Turbo)

The giant context windows are fantastic for whole-project / whole-module conversations that goes on for long time. The ability to rewind exists in other AI plugins, and would like ai-genie to do something similar too.