How to evaluate local custom models?

Question

How to evaluate local custom models?

VoiceBeer opened this issue a year ago · 4 comments

Hi, thx for the work. Is there any way to evaluate custom models on this benchmark?

Answer 1 · 2023-11-29T07:05:59.000Z

Thank you for your attention to the work. We are in the process of organizing the execution environment, and we will release the Docker image and its usage instruction within a week.

Answer 2 · 2023-11-29T07:08:34.000Z

Thx, looking forward to the next process :>

Answer 3 · 2023-12-18T03:44:31.000Z

@VoiceBeer Hi, you can check this: https://github.com/gersteinlab/ML-Bench/tree/master/Execution%20env.
Hope that helps!

Answer 4 · 2023-12-18T04:19:28.000Z

Hey thx, i'll check it out