wandb/weave

Add support for Gemini API

masterbatcoderman10 opened this issue · 7 comments

masterbatcoderman10 commented

I'm creating this issue to request support on the Gemini API, currently, tracked calls for the Gemini API do not show any information on the token/cost breakdown, therefore, please enable support as you have for Mistral, and Anthropic.

jwlee64 commented

Hi,
I am one of the developers for weave, we can add cost support for gemini apis.
Could you send the link to the project your are working in so I can ensure that the eventual fix works for your project?
I will ticket and add to backlog.

masterbatcoderman10 commented
morganmcg1 commented

@masterbatcoderman10 just to let you know that @soumik12345 is working on a PR at the moment to add support for Google AI Studio

#2078

tcapelle commented

The integration is merged now; I think token usage should be there: #2399

masterbatcoderman10 commented
ramon-prieto commented

@tcapelle this is still not working if using the vertexai library, which is the preferred method if accessing Gemini via GCP. Any chance it can be implemented?

soumik12345 commented

@ramon-prieto Thanks for raising the issue with the vertexai integration. I have raised a PR #3110 to fix it.