Unreproducible: the error - "Could not parse LLM output" causes inability to reproduce.

Question

Unreproducible: the error - "Could not parse LLM output" causes inability to reproduce.

Opened this issue 3 months ago · 2 comments

Octobrist commented 3 months ago

When using chatgpt as LLM, it generates a lot of such errors:

"Could not parse LLM output".

I found that chatgpt did not call the tool as expected by prompt.

In addition, when I call chatgpt in langchain, it will not stop according to the stop word. -

"ASSISTANT Observation: "

Any solutions? Thanks you.

Answer 1 · 2024-04-28T03:29:13.000Z

I would like to ask when you conducted the chatgpt experiment?
Is it because the chatgpt model has been updated that the original prompt has become invalid?

Answer 2 · 2024-06-04T07:43:14.000Z

Did you use an appropriate prompt to prompt the model to output 'ASSISTANT Observation'?