usnistgov/jarvis_leaderboard

Add benchamrk/dataset checkers/validators

knc6 opened this issue · 0 comments

knc6 commented
  • Whether the benchmark has entries for all the keys in the dataset
  • If the new benchmark already exists, e.g. a user just uploads the example alignn exfoliation energy as a new benchmark name
  • Avoid property name duplication, for example formation_energy_peratom should be in dft_3d dataset only and not in say hmof dataset to avoid any conflict
  • Mixing accuracies say MAE and ACC e.g. for bandgap models