janhq/jan

bug: Clicking on Stop Generation deletes current response

Closed this issue · 2 comments

khosravipasha commented

Version: e.g. 0.5.x-xxx

Describe the Bug

Not sure if bug or by design but when I click on the stop generation button it deletes the currently generated response. Would it be possible to keep the current generated response instead of deleting it?

Steps to Reproduce

  1. Downloaded a model, e.g. Meta-Llama-3-8B-Instruct_Q4_K_M
  2. Start generation with any prompt
  3. Hit Stop button before prompt is finished generation
  4. After that the already generated output gets deleted.

Screenshots / Logs

Operating System

  • MacOS
  • Windows
  • Linux
github-actions commented

Found 3 possible duplicate issues:

  1. #5571
  2. #6823
  3. #5909
khosravipasha commented

Closing, seems there are some solutions in the work
#6697