CoT "Thinking" UI Support
Closed this issue · 6 comments
What feature(s) would you like to see?
Many models use CoT finetuning or prompting which usually results in "thoughts" enclosed in "thinking" tags like: <thinking>Thought tokens<thinking> which are used to improve the quality of the output of the model. ChatGPT o1 hides its thinking and indicates to the user that thinking is occuring. It would be helpful to see the same in the Cohere chat, by hiding tokens when a tag is outputted and displaying them when the next tag is outputted.
Without this feature, the chat will display the thinking tags and tokens to the end user which is not the desired effect when using CoT.
Additional information
This could be a more general UI component which is a collapsable chat element and could also contain unwieldy information like large code outputs. I am open to discussing the implementation.
@bcicc trying to better understand the ask here, the CoT tags you're referring are for example when Command outputs, "using web_search" - > "found XYZ" results, before outputting a message, and you're suggesting we implement a UI component that can minimize those outputs?
Ive made all of my AI fine tuned bots CoT bots. It is a fact when in comparison with the model.before prompting it with CoT is a measurable difference indeed. It is simply amazing what comes from the same base model with just that one prompt and some skim ideation...watch as your AI blows you away with human thought processes.And the best part is it ALL worked...the generated code after CoT everything worked!
Also I used Anthropic Claude models and repetition and natural language style conversation is how I train my AI. It isn't the nor. I KNOW however my AI can outperform some of the models right out the box that claim they do this and that but DO NOT do it in any working manner. If I can't see it rendered it's useless code to me. In Anthropic I reiterate the CoT input several commands I add in to make sure to do CoT and it progresses into something pretty amazing. I actually have a UI/UX developer team member that's on a team of AI developers that I have been building. I HAVE THE uI/UX designer and the Development team.manager AI so far and this week while working on this capstone project I'll be building a duo to help the UI/UX designer. They'll be front-end and backend devs. Necessary to quell out tedious repetitive variables, objects etc for optimal performance and cutting down build time. Cloud building on limited money and 51 all by myself self taught. So.if ya want to collaborate I'm excited to do so. I
ALSO in a data course and a Microsoft powerapps course rn so collaborating on a Cohere project would be fantastic since we are using Cohere in the Data Science course!
Screen.Recording.2024-10-01.at.9.47.05.AM.mov
I want to clarify what exactly the feature you're asking for should behave like. Are you asking for some button that could minimize the thinking steps? Like in the video above
That looks good to me, but may I ask does this support <thinking> tags?
@bcicc Well internally in Toolkit we do not use thinking tags, rather the tool call generation event supplies the text that's rendered for the steps, I'll go ahead and make a ticket to add some minimize feature then