TonicAI/tonic_validate

Support fine-grained metrics

peter-did-mh opened this issue · 0 comments

Hello, could you please add support for more fine-grained metrics, possibly user-definable, like time to get embeddings, time to retrieve chunks from a vector database, time to get first bytes from streaming LLM etc.? That would give us a much better view of important metrics and possible regressions.