Finding the exact testing procedure executed for each metric

[rgiessmann]

Dear team,

I really enjoy the FAIRevaluator and think you have chosen a great architecture to implement testing of current and upcoming FAIRmetrics.

I understood that I can look into the markdown files for human-readable description of the metrics; what I did not get is where I can find the source code of the metric evaluators themselves. Are there links to the source code somewhere, or could we integrate those links into the human- and machine-readable descriptions?

Thanks in advance for taking the time to answer this newbie question! If my question is valid, it would be great to include this into the README as well (I am happy to contribute!).

Best,
Robert

[markwilkinson]

Thank you for the kind words. The code for the tests lives here:

https://github.com/FAIRMetrics/Metrics/tree/master/MetricsEvaluatorCode/Ruby/metrictests

AFAIK, it is up-to-date with the deployed versions of the tests.

Comments/criticisms of the tests are VERY welcome! If you think a test is unfair (or unFAIR) please suggest an alternative approach, or build a new MI and new test. The objective is for this to be a community effort.

Cheers!

[rgiessmann]

Hi Mark,

I see, I didn't recognize that organization of the file system. How open are you for unsolicited contributions? Shall I just fork and make a pull request afterwards?

I will think about a way to implement this back-linking to the tests when time allows, and am happy to contribute more to this community effort. We are actively applying the FAIRevaluator in the IMI project FAIRplus, I hope that there will be a lot of feedback coming up, indeed! :)

Best,
Robert

[markwilkinson]

Yes, please fork and do a pull request.
We're hoping to find a formal arms-length mechanism for evaluating the tests (both our own, and community-sumitted tests), and "blessing" them... this is TBD...
Cheers!