Return cost in minutes of inference

Question

Return cost in minutes of inference

Closed this issue a year ago · 5 comments

Users have a finite number of minutes of inference per-month.

It would be useful to see how many compute minutes Replicate has charged for a given inference once it has completed.

This could be useful for allocating time to a given user, or simply profiling.

I've been looking at the code, and am not seeing anything that does this. However it seems like something that could be a member of the Prediction class.

Answer 1 · 2022-07-04T20:06:49.000Z

I think is a great idea

Answer 2 · 2023-03-11T10:28:53.000Z

I strongly agree it a good idea. I really need it.

Answer 3 · 2023-04-20T16:10:54.000Z

antomin commented 2 years ago

Answer 4 · 2023-08-05T20:13:05.000Z

any updates on this?

Answer 5 · 2023-08-07T11:25:20.000Z

As of #136, you can now get the predict time in seconds through the metrics field of a prediction.

prediction.metrics['predict_time']

This is available in version 0.11.0.