API for submitting and getting numbers from Newly introduced "Diagnostics Tool"

Question

API for submitting and getting numbers from Newly introduced "Diagnostics Tool"

Closed this issue 3 years ago · 3 comments

anandi1989 commented 3 years ago

Previously user can submit prediction and get expected Sharp Ratio, Corr, MMC information . Now that Numerai introduced new tool "Diagnostics Tool" - Can we have API for the same.

Answer 1 · 2021-10-06T19:41:04.000Z

You can already do that like this for "classic"

>>> napi = NumerAPI(secret_key="..", public_id="..")
>>> model_id = napi.get_models()['uuazed']
>>> api.upload_diagnostics("prediction.cvs", model_id=model_id)
'93c46857-fed9-4594-981e-82db2b358daf'
>>> napi.diagnostic(model_id)
{"validationCorrMean": 0.53231,
...
            }

Answer 2 · 2021-10-07T06:07:53.000Z

In the dev version, this now works for signals as well. Will be available with the next release.

Answer 3 · 2021-10-07T07:50:01.000Z

In the dev version, this now works for signals as well. Will be available with the next release.

Thanks... That helps. Looking forward to the next release