Enhancement: Add token count to conversations
Closed this issue · 1 comments
rmusser01 commented
As a user, I would like to be informed and aware of how long a conversation is, in tokens, so that I may be aware of when I am hitting context limits or droppoffs in coherency due to context size.
This should exist as a toggleable UI element, which will show '#### Tokens in current conversation', indicating to the user the total token count to the current message, allowing them to make more informed decisions.
rmusser01 commented
Realistically, just 'approximate' it, since different tokenizers with no sure way to know, so meh.