Lookup Tool Stalls

Question

Lookup Tool Stalls

Opened this issue 18 days ago · 8 comments

jaickler commented 18 days ago

Bug

When using smart chat the lookup tool will show hypotheticals and then the loading wheel will display indefinitely.

Expected behavior

Recurve message from LLM after lookup finishes.

How to replicate

Use gpt-4o-mini with tools results being sent in user message or not.
Trigger the lookup tool.
Wait indefinitely for message to return.

Notes

I am using Linux on my laptop and do not have mobile enabled. Embedding have fully loaded already.

Answer 1 · 2024-12-07T21:48:57.000Z

Hi @jaickler

Are there any errors in the developer console logs when this happens?

Thanks for the report
🌴

Answer 2 · 2024-12-08T01:28:31.000Z

Hello! Yes, I was able to check the developer logs and saw the vector sizes didn't match. I deleted the multi folder and then relaunched Obsidian and that fixed half the issue. The other half is that when using OpenAI's 4o-mini model I have to send the tool results in the user message or I also receive errors.
Sending the results in the user message does allow chat to work normally though.

I suppose the nature of the current bug is that, at least for 4o-mini the tool results must be sent in the user prompt.

Answer 3 · 2024-12-08T03:37:49.000Z

Thanks for following up.

4o-mini seems to be working with/without sending tools response in the user message. Does toggling that setting on/off consistently produce the same success/fail results for you?

Please do let me know if you notice any other patterns or anything that might help narrow down what might be causing the issue 🌴

Answer 4 · 2024-12-08T12:52:46.000Z

I'm having the same problem with gemini

Answer 5 · 2024-12-08T14:52:05.000Z

@jaickler @Keffus any screenshots that might help me better see what's going on would be helpful 🌴

Answer 6 · 2024-12-08T15:11:23.000Z

yeah sure, on the first screenshot i asked gemini if it can summarize the wiki description of cat and it did it but only in lookup, and it was loading the answer indefinitely. But when i asked the next question it responded normally(second screenshot). I think the lookup thing is related to asking about the vault because when i dont do it it answers normally. I have the review context option turned off.

Answer 7 · 2024-12-08T15:13:47.000Z

I check one more think i opened a new chat and just asked if it can tell me somethink(didn't ask to use vault) and it did answer in lookup only so I don't think it is realed to vault

Answer 8 · 2024-12-08T15:21:20.000Z

I don't know how much this will help but i have figure out that if gemini can't answer the question it will anser normally(without lookup

)