Cost and Tokens Metrics in OpenSearch Dashboard

[DiljithNair]

Would like to have a metrics in the OpenSearch dashboard of the qnabot to show the cost incurred by the bot in real-time along with the number of tokens (input and output) used by the foundational model used.

A OpenSearch visualization using qnabot logs showing the cost incurred and tokens consumed by the bot to analysts to make data driven decisions and tweaks to the bot.

[abhirpat]

Thank you for reporting this @DiljithNair. We will get back to you.