vercel/ai-chatbot

streamUI vs render 😢

Opened this issue · 0 comments

first off, huge props to you guys for putting this project out into the world, including the AI SDK work.

Im running into a problem with streamUI that I didn't experience with render. for some reason, it always wants to use tools even when it already has the info.

streamUI example:

user: get today's events
assistant: [ok here are all of today's events in a nice ui] 
user: awesome, suggest 3 times to schedule a 15 minute call this pm
assistant: [ok here are all of today's events in a nice ui] 
user: can you just write it in plain text
assistant: [ok here are all of today's events in a nice ui] 

it's as if it's unable to look at its memory/history and just pull from there.
ps: when I print aiState.get(), I see all history.
pss: I followed the migration guide -- made sure it aligns with this commit 095550d

render example:

user: get today's events
assistant: [ok here are all of today's events in a nice ui] 
user: awesome, suggest 3 times to schedule a 15 minute call this pm
assistant: seems like you're free at 4,5,6 so just pick which one works best

I've tried tweaking temp/top_p and the system prompt to no avail. I didn't make any changes other than what were mentioned in the migration guide.
I've downgraded to 3.0.12. Using render still works great so I'm going to keep using it until this is addressed.

Thank you @vercel team