materialsproject/matbench

Issues

• Benchmark Confirmation on KGCNN

  #254 opened a year ago by chao1224
  9

• confusion on lack of validation sets

  #233 opened 2 years ago by Breaddsmall
  3

• installation error with python3.10

  #269 opened a year ago by hspark1212
  3

• Unable to add label to pull request

  #266 opened a year ago by desmond-molloy-mcl
  0

• How to convert to `torch_geometric`

  #207 opened 2 years ago by vict0rsch
  1

• Doesn't seem like per-task plots are being regenerated correctly?

  #259 opened a year ago by ardunn
  5

• Follow-up of Benchmark Confirmation on coGN and MODNet

  #262 opened a year ago by chao1224
  0

• Need to upgrade to newer version of EndBug add-and-commit soon, as features from v7 are being deprecated

  #260 opened a year ago by ardunn
  3

• Update Website Generator with Stats from Uncertainty Quantification

  #110 opened 3 years ago by ardunn
  6

• `to_file` and `from_file` are not implemented correctly: no compression

  #249 opened a year ago by ardunn
  1

• Top of leaderboard page should mention and link to matbench-discovery

  #252 opened a year ago by ardunn
  1

• Getting MP IDs

  #247 opened 2 years ago by hasan-sayeed
  2

• Mismatch with the Latest Packages and Data Query

  #250 opened 2 years ago by chao1224
  2

• FSGN

  #246 opened 2 years ago by ardunn
  0

• Datestamps are not loaded correctly

  #234 opened 2 years ago by ardunn
  0

• Potential for a kaggle competition

  #195 opened 2 years ago by sgbaird
  2

• Pymatviz figures need refinement before they can be shown on main website/MP

  #172 opened 2 years ago by ardunn
  25

• Discussion on a `matbench-generative` benchmark: what it might look like and where to put it

  #150 opened 2 years ago by sgbaird
  19

• Can the Matbench submission process be handled entirely within a Google Colab notebook?

  #196 opened 2 years ago by sgbaird
  2

• [Feature Request] add task.unload() function to free up memory

  #197 opened 2 years ago by sgbaird
  0

• Documenting which algorithms/repos have installation problems

  #194 opened 2 years ago by sgbaird
  0

• setup.py should read requirements files for single source of truth

  #193 opened 2 years ago by ardunn
  0

• Consider Elo-based system for scoring/comparing algorithms

  #190 opened 2 years ago by ardunn
  0

• add megnet and SchNet

  #61 opened 3 years ago by ardunn
  6

• Trying to load a partially recorded benchmark from disk raises ValueError

  #134 opened 2 years ago by janosh
  2

• score_array computes roc-auc values on discretized predictions

  #181 opened 2 years ago by pbenner
  1

• Tasks with uncertainty should enforce all folds have uncertainty

  #162 opened 2 years ago by ardunn
  0

• hash not matching, (failing tests) seems related to matminer

  #155 opened 2 years ago by sgbaird
  2

• please delete

  #168 opened 2 years ago by sgbaird
  0

• Add more info on how data was collected/snapshotted/filtered etc.

  #165 opened 2 years ago by ardunn
  0

• Citing matbench and automated archival of releases

  #156 opened 2 years ago by ml-evs
  2

• Look into docker for reproducibility

  #163 opened 2 years ago by ardunn
  0

• How does ROCAUC work in score_array()?

  #137 opened 2 years ago by janosh
  1

• How is metallicity determined via pymatgen for the `mp_is_metal` classification task?

  #122 opened 3 years ago by sgbaird
  1

• `rebuild_docs.py` not working on Windows due to UnicodeEncodeError

  #114 opened 2 years ago by sgbaird
  1

• Trying to pickle `RecursiveDotDict` raises `TypeError`

  #129 opened 2 years ago by janosh
  2

• Using `e_above_hull` values that correspond to the Matbench folds and formation energy values

  #124 opened 3 years ago by sgbaird
  0

• include RooSt and newer versions

  #116 opened 3 years ago by ardunn
  2

• Question: adding newer versions of existing benchmarks

  #75 opened 3 years ago by ml-evs
  1

• Potential for stability dataset in matbench v1.0

  #104 opened 3 years ago by sgbaird
  10

• Hyperparameter optimization, matbench tasks, and submission potential

  #86 opened 3 years ago by sgbaird
  1

• Add flag for tasks that contain polymorphs

  #71 opened 3 years ago by CompRhys
  3

• Pip install results in problems accessing MatbenchBenchmark.info

  #34 opened 3 years ago by ardunn
  0

• Add ability to record uncertainties along with each prediction

  #42 opened 3 years ago by ardunn
  3

• Error when recording group probability results to classification tasks

  #40 opened 3 years ago by ml-evs
  7

• install page link broken

  #54 opened 3 years ago by computron
  0

• Add the ability to load a subset of data to task.load()?

  #35 opened 3 years ago by mm04926412
  1

• How to featurize a task?

  #36 opened 3 years ago by mm04926412
  2

• Large change to the leaderboard position of CGCNN

  #22 opened 3 years ago by mm04926412
  1

• MatbenchTask to_file using as_dict will not work if np.arrays are stored as user params

  #9 opened 3 years ago by ardunn
  1